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Creative Evolutionary Systems 


Chapter 1 


An Introduction to 
Creative Evolutionary Systems 


By Peter J. Bentley and David W. Corne 


1.1 Introduction 


In many ways, using the word ‘creativity’ in a field of computer science opens up a Pandora's box of 
controversy. Convincing people that our creativity can be enhanced using computer software is 
sometimes difficult. Arguing with people that the techniques themselves might be capable of creativity is 
often futile. But there are an increasing number of researchers prepared to try. 

These are the researchers who pioneer creative evolutionary systems. Their programs enable artists to 
evolve stunning pieces of art, or allow musicians to create new sounds and new compositions. By guiding 
evolution as it happens, the users are able to explore new ideas as they emerge through the mechanisms of 
evolution. Many find this a highly rewarding activity - exploring the space of possible images or 
sculptures or compositions, and being constantly surprised as possibilities are revealed to them. Other 
creative evolutionary systems take this approach one step further. Guidance is provided by automatic 
software routines that judge evolving solutions without the need of human input. Designs are evolved 
from random blobs to fully functional forms. Novel circuits, boat hulls, architectural forms, aircraft 
manoeuvres, even chemical structures are now routinely evolved by computers. This automatic 
generation of innovation by creative evolutionary systems allows our designers to consider more 
solutions faster. These systems allow us to sidestep limitations of ‘conventional wisdom’ and ‘design 
fixation’. Creative evolutionary systems can even suggest entirely new methods and principles that we 
can then exploit in our own designs. 

The list of applications of these approaches is long and increasing at a ferocious rate. But we are still 
only taking the first steps along this road. We are still learning how to enable evolutionary computation to 
provide us with this kind of assistance. There are as many problems yet to overcome as there are debates 
about the topic. The chapters in this book are our best answers so far. 

Thankfully we have a very good mentor to inspire us and help us when we run into difficulties. 
Natural evolution is a very creative problem solver, and the solutions of nature are ever present to remind 
us just what evolution is capable of. Can we make a machine three millimetres long that is capable of 
flying under it own power? What about giving it sight, or the ability to keep itself functioning by 
converting chemicals into energy, or even the ability to make copies of itself? We simply do not have the 
know-how to achieve these marvels. But this is what nature has achieved in a creature as simple as a fly. 
Other examples abound. For example, would we have thought of turning flippers designed to propel fish 
through the water into arms and highly dexterous hands? Would we have thought of using hair to make 
the horn of a rhinoceros? Despite the constraints nature is faced with - only a small number of materials 
available, the fact the life must grow from a single cell and maintain itself - the creativity of nature is 
overwhelming. We do not have to wait for some science fiction scenario where aliens from other worlds 
give us superior technology - the technology of the natural world is already all around and within us - and 
it is vastly superior to our technology. 
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1.1.4 What’s to Come 


This chapter gives an introduction to Creative Evolutionary Systems. It is structured into three major 
sections: first, section 1.3 gives a general summary of Evolutionary Computation and the dominant 
Evolutionary Algorithms. Second, definitions and reviews of the significant aspects of Creative 
Evolutionary Systems are provided in section 1.4, to place the contents and structure of the rest of the 
book into context. Finally, we discuss the debate on creativity and evolution in section 1.5 - is evolution 
really creative? But before we look at evolutionary computation, let’s take a brief look at some of the 
other AI approaches used for creative applications. 


1.2 Al and Creativity 


Art, music and designs have been emerging from computers for many years. Evolutionary systems are a 
promising technique for such enterprises, recently growing in favour. However, several other techniques 
have been used and explored with creative products in view. Artificial Intelligence (AJ) is the field within 
which much of this work takes place, and three main areas of that science are commonly involved in AI- 
based creativity research. These are Knowledge Based Systems, Grammars, and Search. Non- 
evolutionary creative systems are, by definition, not in the scope of this book, but it makes sense to 
provide the reader with the flavour of non-evolutionary approaches in this area. In fact, it seems 
reasonable to expect that some success in the creativity realm will emerge from hybridisations of 
evolutionary systems with other AI methods. 

Knowledge Based Systems (KBS) come in very many forms, but their characteristic feature is 
their incorporation of expert knowledge in some domain, usually in the form of rules. Obviously, since a 
KBS needs experts’ rules about a domain, the rules themselves need to be acquired from experts. 
According to many definitions, this would seem to rule out the possibility of a KBS being creative. 
However, a KBS is rescued by what will be a recurring theme in the chapters of this book. Results which 
seem usefully or pleasingly novel can arise from a ‘constrained exploration’ within the parameters of the 
given knowledge. We see this often in musical KBS which incorporate knowledge of the style of a 
particular composer, and which are then used to produce new compositions in that style. For example, 
Ebcioglu (1988) discusses a system which harmonizes chorales in the style of J.S. Bach, and Pachet et al. 
(1996) discuss a system for real-time jazz improvisation. Both of these incorporate considerable domain 
knowledge about the styles of music in the domains of interest, and attempt to generate novelty within 
those constraints. 

Grammars are an alternative way of representing knowledge in a particular domain. Grammars 
embody rules about languages. The grammar of English, for example, specifies that adjectives should 
come just before the nouns to which they are applied. The grammar of French begs to differ. With both, 
and indeed with all natural languages, violations of the rules tend to be allowed, and this lenience 
facilitates creativity. Grammars have played a part in the science of AI for various reasons, usually 
concerning the attempt to computationally understand natural languages, or translate between them. Their 
role in creativity stems from viewing designs or compositions as statements in a language. For example, 
pioneering work on this theme was done by Stiny and co-authors (Stiny & Mitchell, 1978; Stiny, 1980), 
who compiled a grammar for designing villas in the style of Palladio, while later work includes that of 
Knight (1980) who constructed a grammar for Hepplewhite chair-backs, Koning & Eizenberg (1981) who 
present a grammar for generating house designs in the style of Frank Lloyd Wright prairie houses, and 
Flemming (1987), who presents for designing houses in the Queen Anne style. 
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Finally, search is a foundational concept in AI and refers to the long journey (made speedier via 
computation) through an immense space of possibilities in search of something suitable. We will discuss 
at length, from section 1.3 onwards, how this is done by evolution. However, quite different approaches 
to search have long been a mainstay of AI research. The most explored search technique in AI is heuristic 
search, in which a solution (perhaps a design, perhaps a schedule, and so forth) is constructed gradually, 
bit by bit, with heuristics (rules of thumb) employed to decide how to choose each successive part. This is 
the technique employed by advanced web spiders, for example, which explore the WWW link by link in 
order to find useful new information on a particular topic. In this case, heuristics are used to decide which 
link to explore next. This is also the core technique used by the chess program Deeper Blue, which 
famously defeated the chess champion Garry Kasparov on May 11" 1997". In this case, heuristics are 
used to decide which move to explore next; the search is of each reasonable possible move and its 
consequences, ultimately leading to a decision of which next move is most wise. The main difference 
between the evolutionary search systems we focus on in this book, and classical AI heuristic search, is a 
greater focus on heuristics in the latter. Heuristic searches tend to be quite fussy about the next move, 
concentrating on exploring areas that are sanctioned by the heuristics in use. Although this may seem 
limiting from the viewpoint of creativity, it remains the case that search-based systems can potentially aid 
the creative process by helping designers and artist see more of the space and possibilities than they 
otherwise would. 

We can recommend several books for the interested reader who wishes to further explore either 
basic artificial intelligence, or its role in creative applications: 


Artificial Intelligence 
Elaine Rich and Kevin Knight (1991) 


Artificial Intelligence: A Modern Approach. 
by Start Russell and Peter Norvig (1994). 


Artificial Minds 
By Stan Franklin (1997) 


Dimensions of Creativity 
by Margaret Boden (ed.) (1996). 


Artificial Intelligence and Literary Creativity: Inside the Mind of Brutus, a Storytelling Machine 
by Selmer Bringsjord and David Ferrucci (1999). 


1.3 Evolutionary Computation 


Evolutionary Computation is all about search. In Computer Science and in Artificial Intelligence, when 
we use a search algorithm, we define a computational problem in terms of a search space, which can be 
viewed as a massive collection of potential solutions to the problem. Any position, or point, in the search 
space defines a particular solution (Kanal & Cumar, 1988), and the process of search can be viewed as 
the task of navigating that space. A commonly used term in this context is ‘optimization’, which just 
means ‘finding the best’. For example, just as you might browse through a bookshelf to find the book 
which best suits your needs, you might also browse through a search space to find the solution best suited 


to your specifications. This analogy is more appropriate than it may at first seem; one of the key ideas in 


' In contrast, we note that evolutionary search, rather than classical AI heuristic search, is a key component in 
the similarly notable recent Checkers player presented by Chellapilla & Fogel (1999). 


17 


An Introduction to Creative Evolutionary Systems 


search is that points close together in the space will also tend to be close in terms of quality. In your local 
bookshop, books on creative evolutionary computation are more likely to be close to books on 
evolutionary design than to books on optimisation in general. So, if the first book you happen upon 
during your bookshelf search happens to be Evolutionary Design by Computers (Bentley, 1999a), you 
know that it will be worthwhile to look close by, perhaps even at the directly neighbouring books on the 
shelf, to find a book about creative evolutionary systems. However, if the first book you come upon 
happens to be New Ideas in Optimization (Corne, Dorigo & Glover, 1999), you would do well to 
determine that looking at the directly neighbouring books might be fruitless, and hence you might swing, 
perhaps, a foot either side, or a shelf up or down, in continuing your search. 

More to the point, if during your search you happen to have found each of Evolutionary Design by 
Computers, New Ideas in Optimization, and Evolutionary Algorithms in Engineering Applications 
(Dasgupta & Michalewicz, 1997), you may be able to do a kind of triangulation in this ‘bookshelf-space’. 
The kind of book you seek is likely to be closer to Evolutionary Design by Computers than to any of the 
others, but closer to New Ideas in Optimization than to Evolutionary Algorithms in Engineering 
Applications. If the latter two are found to be respectively to the left and right of EDbC on the same shelf, 
then you would more than likely be right to assume that the book you seek might be to the left of EDbC; 
hence, in a simple way, some knowledge about other solutions in the space has guided you helpfully 
(more likely than not) on your continuing quest. 

Evolutionary search, and most other search methods, all make use somehow of previously visited 
solutions to help decide where to look next. Sometimes, the space includes a massive collection of 
terrible solutions which must be slowly waded through until you eventually find yourself in a decent 
neighbourhood. In other cases, we may already have a good start. For example, we may already have a 
set of parameter values to hand which adequately define a car, as shown in Figure 1.1. We might have 
parameters concerning distance between wheels, and length of body, and so forth. The search shown in 
the figure moves through three car designs, where each move represents a change in one parameter. In 
general terms, this is precisely the sense in which neighbouring solutions in a search space are ‘close’; 
i.e., distance in the space is related to distance in terms of parameter settings. 


Figure 1.1 Searching for a solution in an example search space of car designs. 


There are many types of search algorithm. Evolutionary search is a recent and rapidly-growing sub- 
set, and distinguishes itself from other methods in that the way it works is both inspired by and based 
upon the mechanism of evolution in nature. These algorithms typically use an analogy with Natural 
Evolution to perform search by evolving solutions to problems. Hence, instead of working with one 
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solution at a time in the search-space, these algorithms consider a large collection or population of 
solutions at once. In Figure 1.1, we are actually illustrating a kind of search algorithm called local search, 
in which, at any point in time, we just have a single ‘current’ solution, and we gradually update this with 
improvements as and when we find any better solutions nearby. In contrast, Evolutionary Algorithms 
work with populations of solutions. At any point in time, we have in mind (or, usually, in RAM) a 
population of potential solutions. We use the population as a whole (or at least we use more than one 
constituent of it) to help us determine where to go next in the space, as was illustrated in our bookshelf 
analogy. 

Although Evolutionary Algorithms (EAs) do make computers evolve solutions, this evolution 
process is not explicitly specified in an EA, it is an emergent property of the algorithm. In fact, the 
computers are not instructed to evolve anything, and it is currently not possible for us to explicitly 
‘program-in’ evolution — since we do not fully understand how evolution works. Instead, the computers 
are instructed to maintain populations of solutions, allow better solutions to ‘have children’, and allow 
worse solutions to ‘die’. The ‘child solutions’ inherit their parents’ characteristics with some small 
random variation, and then the better of these solutions are allowed to ‘have children’ themselves, while 
the worse ones ‘die’, and so on. This simple procedure causes evolution to occur, and after a number of 
generations the computer will have evolved solutions which are substantially better compared to their 
long-dead ancestors at the start. In Figure 1.2, for example, we can see three snapshots (generations) of an 
evolution process, with time moving towards the right. The highlighted solutions are those which were 
used as ‘parents’ in generating the succeeding generation. 


GENERATION 1 GENERATION 2 GENERATION 3 


Sai 


Figure 1.2 Three generations of evolving car designs using a population size of four. Parents of the next 
generation are highlighted. 
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Figure 1.3 The location of the evolving car designs in the space of car designs, each generation. Better 
solutions are found in the centre of this example space. 


By considering the search space itself, it is possible to get an idea of how evolution manages to find 
good solutions. Figure 1.3 depicts the search space for the example shown in figure 1.2. It should be clear 
that evolution searches the space in parallel (in the example, it considers four car designs at a time). It 
should also be clear that evolution quickly ‘homes in’ on the best area of the search space, resulting in 
some good designs after only four generations. 

All EAs require some form of guidance to direct evolution towards better areas of the search space. 
In our bookshelf analogy, the guidance used was an intuitive measure of distance: in seeking a book 
about creative evolutionary systems we felt, for example, that a book about evolutionary design was 
closer to our goal than a book about telecommunications. Implicitly, we had a good look at each book 
encountered, and evaluated it in terms of its fitness for our requirements. The better the evaluation score, 
the closer we felt it to be to our goal. In general, EAs receive guidance in just the same way, by means of 
evaluating every solution in the population, to determine its fitness. The fitness of a solution is a score 
based on how well the solution fulfils the problem objective, calculated by a fitness function. Typically, 
fitness values are positive real numbers, where a fitness of zero is a perfect score. EAs are then used to 
minimise the fitnesses of solutions, by allowing the fitter solutions to have more children than less fit 
solutions. In the ‘car’ example, the problem objective might be to find a car design which has adequate 
legroom, suitably placed wheels (to ensure stability), and so on. The fitness function would take a 
solution as input and return a fitness value based on how well the solution satisfies these objectives. 

Fitness values are often plotted in search spaces, giving mountainous fitness landscapes, where a 
high peak corresponds to solutions in that part of the search space which have optimal fitnesses. If the 
problem has many separate optima (i.e., if the fitness function is multimodal), finding a globally optimal 
solution (the top of the highest mountain) in the landscape can be extremely difficult. 

There are four main families of Evolutionary Algorithm in use today, three of which were 
independently developed more than thirty years ago. These algorithms are: the Genetic Algorithm (GA) 
created by John Holland (1973, 1975) and made famous by David Goldberg (1989), Evolutionary 
Programming (EP) created by Lawrence Fogel (1963) and developed further by his son David Fogel 
(1992), and Evolution Strategies (ES) created by Ingo Rechenberg (1973) and today strongly promoted 
by Thomas Bäck (1996). The fourth major Evolutionary Algorithm is a more recent and very popular 
variation of the genetic algorithm by John Koza (1992), known as Genetic Programming (GP). The field 
of Evolutionary Computation has grown up around these techniques, with its roots still firmly in 
Evolutionary Biology and Computer Science, see Figure 1.4. Today researchers examine every 
conceivable aspect of EAs, often using knowledge of evolution from Evolutionary Biology in their 
algorithms, and more recently, using EAs to help biologists learn about evolution (Dawkins, 1986). 
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Evolutionary Evolutionary Computer 


Biology Computation Science 


Figure 1.4 Evolutionary Computation has its roots in Computer Science and Evolutionary Biology. 


Evolution-based algorithms have been found to be some of the most flexible, efficient and robust of 
all search algorithms known to Computer Science (Goldberg, 1989). Because of these properties, these 
methods are now becoming widely used to solve a broad range of different problems (Holland 1992, 
Mitchell 1996). 

In the following sections we briefly summarise the four dominant types of EA, and then we provide 
an overview of a general architecture for EAs, to show how these separate techniques follow a common 
evolutionary paradigm. But first, we look back at some early work which sowed the seeds for this field. 


1.3.1 Seminal Computer Evolution? 


In the early 1950's, first written up in an internal report for Imperial Chemical Industries Ltd, the well- 
known statistician George E.P. Box came up with an innovative idea for improving productivity in a 
chemical process plant. Calling the idea ‘Evolutionary Operation’, Box proposed a system whereby plant 
control settings (such as temperature and percentage concentration of reactants in a chemical process) 
could be deliberately and systematically varied during plant operation, and the results (in terms of the 
percentages of different impurities of the chemical being manufactured) could be recorded. Control 
settings for further batches could then be set according to an analysis of the results found so far. 

Despite going severely against the grain — production managers are notoriously reluctant to alter 
control settings for experimental purposes when things are apparently going quite well without such 
fiddling — Box and co-workers’ ideas were good enough, and convincing enough in terms of potential 
increased productivity, to lead to ‘Evolutionary Operation’ being put into practice in several chemical 
firms in the late 1950s and early 1960s. 

Evolutionary Operation first appeared in a generally accessible publication as Box (1957). In 
use, it was always what we would now call a ‘collaborative evolutionary system’; that is, it was not 
entirely automatic — a human, or a committee of humans, needed to be involved in order to decide how to 
set the controls for the next generation of trials. The human’s role in Box’s method differs somewhat 
from the human’s role in modern collaborative evolutionary systems 

In 1956, a Master’s student at the University of California, Los Angeles, George Friedman 
designed what he called a ‘selective feedback computer’. This was a design for a robotic machine which, 
using Darwin’s principle of Natural Selection, would evolve circuit designs. This machine was never 
implemented, but the ideas in Friedman’s thesis were profoundly perceptive in the way that the potential 


? We are grateful to David Fogel for pointing us towards information on this topic. 
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of evolutionary style search was demonstrated. Around this time, there were other independent 
developments of similar ideas. For example, Friedberg (1958) attempted to (effectively) evolve machine 
code to perform simple arithmetic operations. 

The definitive source for information on such pioneering early studies is the aptly named ‘Fossil 
Record’ book, edited by Fogel (1998). We refer the interested reader there for further meanderings in 
evolutionary computation’s primordial soup. In the following sections, however, we present the current 
state of the field of evolutionary computation, whose roots tend to be in the 70s and 80s, when a range of 
researchers, helped (unlike their 1950s and 1960s precursors) by the availability of decent programming 
languages and fast machines, began to find that evolution-based ideas in computer science could have 
profound and real practical value. 


1.3.2 Genetic Algorithms 


The Genetic Algorithm is perhaps the most well-known and popularised of all evolution-based search 
algorithms, although it is fair to say that this is partly a result of the term ‘Genetic Algorithm’ being often 
used to denote each of the four main families of methods (i.e., it is often used in the way we use the term 
‘Evolutionary Algorithm’). GAs were developed by John Holland in an attempt to explain the adaptive 
processes of natural systems and to design artificial systems based upon these natural systems (Holland 
1973, 1975). Whilst not the first algorithm to use principles of natural selection and genetics within a 
search process, and whilst not necessarily being the ‘best’ approach to take in solving a particular given 
problem, the Genetic Algorithm is today, probably, the most widely used of the four main kinds of EA. 
More experimental and theoretical analyses have been made on the workings of the GA than on the other 
EAs. Also, it happens to be the case that Genetic Algorithm (and enhanced versions of it) resembles 
Natural Evolution more closely than do most other methods; but, again, the extent to which this matters in 
applications will vary greatly. 

Having become widely used for a broad range of optimisation problems in the last fifteen years 
(Holland, 1992), the GA has been described as being a “search algorithm with some of the innovative 
flair of human search” (Goldberg, 1989). GAs are also very forgiving algorithms — even if they are badly 
implemented, or poorly applied, they will often still produce acceptable results (Davis, 1991). GAs are 
today renowned for their ability to tackle a huge variety of optimisation problems and for their consistent 
ability, given at least some thought into setting it up suitably for the application in hand, to provide 


excellent results; i.e. they are robust (Holland 1975, Goldberg 1989, Davis 1991, Fogel 1994). 
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Figure 1.5. Mapping genotypes in the search space to phenotypes in the solution space. 


It is fruitful to view a GA as making use of two separate spaces: the search space and the solution 
space. The search space is now a space of coded solutions to the problem, and the solution space is the 
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space of actual solutions. Coded solutions, or genotypes must be mapped onto actual solutions, or 
phenotypes, before the quality or fitness of each solution can be evaluated, see Figure 1.5. 

GAs maintain a population of individuals, where each individual consists of a genotype and its 
corresponding phenotype. Phenotypes usually consist of collections of parameters (in our ‘car’ example, 
as we saw, such parameters might define the distance between wheels, the length of the body, and so on). 
Genotypes consist of coded versions of these parameters. A coded parameter is normally referred to as a 
gene, with the values a gene can take being known as alleles. A collection of genes in one genotype is 
often held internally as a string, and is known as a chromosome. 

The simplest form of GA, the canonical or simple GA is summarised in Figure 1.6. This algorithm 
works as follows: The genotype of every individual in the population is initialised with random alleles. 
The main loop of the algorithm then begins, with the corresponding phenotype of every individual in the 
population being evaluated and given a fitness value according to how well it fulfils the problem 
objective or fitness function. These scores are then used to determine how many copies of each individual 
are placed into a temporary area often termed the ‘mating pool’ (i.e. the higher the fitness, the more 
copies that are made of an individual). 


INITIALISE POPULATION WITH RANDOM ALLELES 


EVALUATE ALL INDIVIDUALS TO DETERMINE THEIR FITNESSES 


REPRODUCE (COPY) INDIVIDUALS ACCORDING TO THEIR FITNESSES 
INTO 'MATING POOL' (HIGHER FITNESS = MORE COPIES OF AN INDIVIDUAL) 


RANDOMLY TAKE TWO PARENTS FROM ‘MATING POOL' 
USE RANDOM CROSSOVER TO GENERATE TWO OFFSPRING 
RANDOMLY MUTATE OFFSPRING 
PLACE OFFSPRING INTO POPULATION 
HAS POPULATION BEEN FILLED WITH NEW OFFSPRING? 


| YES 


IS THERE AN ACCEPTABLE SOLUTION YET? 
NO (OR HAVE x GENERATIONS BEEN PRODUCED?) 


| YES 
FINISHED 


Figure. 1.6 The simple Genetic Algorithm. 


Two parents are then randomly picked from this pool. Offspring are generated by the use of the 
crossover operator, which randomly allocates genes from each parent's genotype to each offspring's 
genotype. For example, given two parents: 'ABCDEF' and 'abcdef’, and a random crossover point of, say, 
2, the two offspring generated by the simple GA would be: 'ABcdef and 'abCDEF’, see figure 1.7. 
(Crossover is used about 70% of the time to generate offspring, for the remaining 30% offspring are 
simply clones of their parents.) Mutation is then occasionally applied (with a low probability) to 
offspring. When it is used to mutate an individual, typically a single allele is changed randomly. For 
example, an individual '111111' might be mutated into '110111', as illustrated in Figure 1.8. 

Using crossover and mutation, offspring are generated until they fill the population (all parents are 
discarded). This entire process of evaluation and reproduction then continues until either a satisfactory 
solution emerges or the GA has run for a specified maximum number of generations. (Holland 1975 


———— 
Goldberg 1989, Davis 1991). 
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Figure 1.7. The behaviour of the crossover operator. The vertical line shows the position of the random 
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Figure 1.8. The behaviour of the mutation operator. 


The randomness involved in the genetic operators can give the illusion that the GA, and other EAs, 
are nothing more than parallel random search algorithms, but this is far from the case. Evolutionary 
Search has a random element to its exploration of the search space, but the search is unquestionably 
directed by the ‘survival of the fittest’ principle. In the simple example GA algorithm just described, this 
principle comes into play when we decide which chromosomes can join the mating pool and hence be 
parents for the next generation. This decision process is called selection, and as long as the decision is 
made in such a way that better fitness gives more chance of being selected, the survival of the fittest 
principle is in operation, and there is selection pressure towards areas in the search space that contain 
better solutions. 

Unless the genetic operators are very badly designed, an EA will always 'home-in' on these areas. 
The same is true, to some extent, of local search methods which navigate the space one solution at a time, 
in the way we saw illustrated by Figure 1.1. It is easy to imagine, however, that such a process might 
soon get stuck at a so-called local optimum — a solution which is far from best, but whose immediate 
neighbours in the space are all even worse. Part of the power and success of EAs lies in the fact that the 
insistence on maintaining a population of solutions is very helpful in avoiding such dead ends (Goldberg, 
1989). 

However, the simple GA is just that — very simple and a little naive. This type of GA is generally not 
capable of solving difficult search problems, but is favoured by those that try to theoretically analyse and 
predict the behaviour of Genetic Algorithms. In practice, typical applied GAs are usually considerably 
more advanced. The basic principles remain: a population of solutions, evolving according to the survival 
of the fittest principle, and new candidate solutions are produced by mutation and/or crossover operators, 
but the details are usually quite different. Common features include more advanced selection 
mechanisms, more sophisticated genetic operators, incorporation (hybridisation) with other algorithms, 
ability to detect when evolution ceases, and overlapping populations or elitism (where some fit 
individuals can survive for more than one generation) (Davis, 1991). Many of the typical improvements 


arakat laiali 
over the simple GA are in the direction of increased similarity to natural evolution. For example, the use 
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of spatially structured populations, slower gradual change in the population membership, inclusion of an 
‘age’ element in the fitness calculation, genotype to phenotype mappings which involve something akin 
to ‘development’, and so forth. In line with this improved analogy with nature, the term reproduction is 
normally used as it is in biology to refer to the entire process of generating new offspring, encompassing 
the crossover and mutation operators. (This is in contrast to the somewhat confusing use of the word 
‘reproduction' in some GA literature, where it refers to an explicit copying stage within the simple GA). 


Advanced Genetic Algorithms 


It is in the nature of complex problem solving that we can never guarantee (except for trivial problems 
which we can solve easily anyway) that an evolutionary algorithm or any other algorithm will find an 
optimal solution in reasonable time. However, we would at least expect our EA to have a good stab at the 
problem, and attempt to exploit fully the information in the population and the power of its operators. A 
common problem arises when this doesn't happen, and we have a situation termed premature 
convergence. This is where the population converges early onto non-optimal solutions, and further 
evolution seems unable to push towards anything better (Davis, 1991). Even if we can avoid premature 
convergence (so that the algorithm at least exploits all the time available to it), we remain far from 
guaranteed to converge on anything like the best solutions possible. Highly ‘deceptive’ problems can be 
defined, for example, which will cunningly mislead the course of evolution. In addition, noisy functions 
(Goldberg et al. 1992) and the optimisation of multiple criteria within can cause other difficulties 
(Fonseca and Fleming, 1995). In attempt to address such problems, new, advanced types of GA are being 
developed. These include: 


e Steady-state GAs, where offspring are generated one at a time, and replace existing individuals 
in the population according to fitness or similarity. Convergence is slower, but very fit solutions 
are not lost (Syswerda, 1989). 

e Parallel GAs, where multiple processors are used in parallel to run the GA (Adeli and Cheng 
1994, Levine 1994). 

e Distributed GAs, where multiple populations are separately evolved with few interactions 
between them (Whitley and Starkweather 1990) 

e GAs with niching and speciation, where the population within the GA is segregated into 
separate 'species' (Horn 1993, Horn and Nafpliotis 1993, Horn et al. 1994). 

e Messy GAs (mGAs), which use a number of ‘exotic’ techniques such as variable-length 
chromosomes and a two-stage evolution process (Deb 1991, Deb and Goldberg, 1991). 

¢ Interactive GAs (IGAs), or collaborative GAs where user interaction takes over some or all of 
the role of the fitness function. 

e Miultiobjective GAs (MOGAs), which allow multiple objectives to be optimised with GAs 
(Schaffer 1985; Srinivas & Deb, 1995; Bentley & Wakefield, 1997; Zitzler & Thiele, 1999; 
Knowles & Corne, 2000). 

¢ Hybrid GAs (hGAs), e.g. memetic algorithms, where GAs are combined with local search 
algorithms (George, 1994; Radcliffe & Surrey 1994a; Moscato, 1999). 

e Structured GAs (sGAs), which allow parts of chromosomes to be switched on and off using 
evolveable 'control genes' (Dasgupta and McGregor 1992, Parmee and Denham 1994). 

e GAs with diploidy and dominance, which can improve variation and diversity in addition to 
performance (Smith & Goldberg, 1992b). 

e Mutation-driven GAs, such as Harvey's SAGA (Harvey, 1992), which uses converged 
populations modified primarily by mutation to allow the constant 'incremental evolution’ of new 
solutions to varying fitness functions. 
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e GAs with ‘genetic engineering’, which identify beneficial genetic material during evolution 
and prevent its disruption by the genetic operators (Gero & Kazakov, 1996). 

e Injection Island GAs (IIGAs), which evolve a number of separate populations (‘islands') with 
representations and fitness functions of different accuracy, and occasionally ‘inject’ good 
solutions from one island into another (Eby et al., 1997). 


This is by no means a complete list. Some of these advanced types of GA are described further in the 
chapters of this book. 


Recommended Books for GAs: 


Adaptation in Natural and Artificial Systems. 
by John Holland (1975). 


Genetic Algorithms in Search, Optimization & Machine Learning. 
by David Goldberg (1989). 


The Handbook of Genetic Algorithms. 
edited by Lawrence Davis (1991). 


Genetic Algorithms + Data Structures = Evolution Programs. 
by Zbigniew Michalewicz (1996). 


Practical Handbook of Genetic Algorithms. 
edited by Lance Chambers (1995). 


An Introduction to Genetic Algorithms. 
by Melanie Mitchell (1996). 


Evolutionary Computation : Toward a New Philosophy of Machine Intelligence. 
by David B. Fogel (1995). 


The Design of Innovation: Lessons from Genetic Algorithms 
by David Goldberg (2000). 


1.3.3 Genetic Programming 


Genetic Programming (GP) is a specialised form of Genetic Algorithm, which manipulates a very specific 
type of chromosome using genetic operators which are carefully crafted to the task in hand. The kinds of 
chromosome manipulated in GP are programs, which can usually be represented as tree-like structures. 
Seeds were sown for this type of idea by Cramer (1985), but GP was developed and popularized by Koza 
(1992), who managed to show convincingly that this idea has great potential. Practitioners of GP are 
beginning to move away from the original application of evolving computer programs, with GP now 
being applied in alternative areas, creative evolutionary applications amongst them. John Koza describes 
one such application in his chapter in the evolutionary design section of this book. 

The underlying algorithmic structure of GP is essentially the same procedure as already described for 
GAs. Where GP distinguishes itself is in the nature of the chromosome and operators. Rather than the 
fixed-length string based representation common in GAs (and other types of EA), GP evolves variable- 
sized hierarchical tree-structures which can be interpreted as computer programs or functions. Figure 1.10 
shows an example. You should be able to see how the chromosome in Figure 1.9 might represent a 
simple program to control a robot. In pseudocode, this program might be: 
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repeat 3 times 
{ move 3 steps forward 
move 2 steps to the right 
repeat 2 times 
{ move back 1 step 


C repeat > 
"i a. 


/ 


SS — —— 


C forward) < right > a l repeat > 
3 2 2 C baok >) 


" 


4 
Figure 1.9 A simple computer program defined by GP's hierarchical representation. 
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Figure 1.10 The behaviour of the crossover operator in GP. The highlighted subtrees in the parents have 
been exchanged to produce the children. 


Clearly, crossover operators and mutation operators of the kind illustrated in Figures 1.7 and 1.8 are 
not suitable here. Koza's approach, and what is now standard in GP, is illustrated in Figure 1.10. 
Randomly chosen branches of two parent trees are simply interchanged to produce a pair of child trees 
which will typically be quite different from each other and from either parent. GP's mutation operator is 
also specialised in the same sort of way. This operator picks a random subtree, and replaces it entirely 
with a new randomly generated subtree. In Figure 1.10, for example, Child 1 could have been generated 
as a mutant of Parent 1, where the highlighted subtree in Parent 1 was the one deleted, and the newly 
generated random subtree in its place happened to be the one shown. Actually, partly owing to the ability 
of crossover to handle the role of mutation in GP, mutation in GP is sometimes considered unnecessary 
(Koza,1992). 

The typical applications addressed by GP bring along other specialised baggage, most notably in 
connection with the evaluation of solutions. In a typical EA application, as we have described, we usually 
have a routine at hand which we can use to assign a fitness score to a candidate solution, and the 
calculation is often relatively straightforward. In GP, however, a solution is a program, and we must run 
the program, usually several times, to get an idea of how good it is at meeting the requirements. 
Alternatively (and this is also sometimes the case with other EAs), a single run of the program is needed 
to generate or ‘grow’ a solution, and then we can apply a straightforward fitness function to it. Normally, 
when we are trying to evolve a program, a series of input values and desired output values are provided, 
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and the fitness of the program is based on how closely actual output values match the desired output 
values, for each set of input values. 

Programs evolved by GP, or indeed created by humans, may often contain redundant or unused code; 
such code is often called junk or introns. For example, the following simple robot control program 
contains two types of junk. Can you tell where? 


repeat 5 times 
{ move 3 steps forward 
move 2 steps to the right 
move 1 step forward 
move 1 step backward 
repeat 2 times 
{ move back 1 step 
} 
repeat 0 times 
{ move 10 steps forwards 


} 


Such junk-filled programs are common in standard GP, with most solutions steadily increasing in 
size as evolution progresses. This tendency is known as bloat (Langdon and Poli, 1997a), and GP 
practitioners tend to limit its effect by adding a penalty to the fitness of any solutions that become 
oversized. 

GP-style programs may also, of course, contain conditional statements, such as “IF A THEN B ELSE 
C”. When such programs are evolved, the effects are interestingly similar to the concept of dominance in 
natural genetics. For example, if in the following conditional statement, the action move-right (3) 
can be considered dominant, and the action move-ahead(2) recessive, since we can expect the 
move-right (3) action to be the one employed about 75% of the time: 


IF (bearing = NORTH) THEN move-ahead(2) ELSE move-right (3) 


In other EAs, however, simulation of dominance and recessive characteristics requires sophisticated 
extensions to the method. For example, a GA might use multiploid chromosomes (a single candidate 
solution (or genome) being composed of two or more distinct chromosomes) where the expressed value 
of a gene depends somehow on the values of the various copies of that gene in the genome. Conditional 
statements in GP also resemble the operons and regulons found in our own DNA, which seem to be used 
to switch on and off other genes during the development of the organism (Paton, 1994). 


Advanced GP 


GP implementations often employ further specialised operators. These include: permutation, which swaps 
two characters in a tree; editing, which allows the optimisation and reduction of long S-expressions; and 
encapsulation which allows a sub-tree to be converted into a single node, preserving it from disruption by 
crossover or mutation. 

A well known and now commonly used advance, which can be seen as a more advanced version of 
encapsulation, is the evolution of automatically defined functions (ADFs). Essentially, after a while, 
certain subtrees which seem to be ‘good’ become treated as units. Typically, the GP system is given a 
predetermined number of possibilities for the nodes and terminals which can appear in trees. When a 
subtree becomes a unit, or an ADF, it is added to this set of possibilities. This saves having to re-evolve it 
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from scratch each time, and also reduces the danger of disruption of good units by crossover or mutation. 
ADFs have been shown to considerably enhance the performance of GP (Koza, 1992) 

. Researchers are exploring other styles of function creation. For example, Yu evolves anonymous 
functions known as A-abstractions, which are reused through recursion (Yu & Clack, 1998a,b). Current 
research also investigates the automatic creation of iterations (ADIs), loops (ADLs), recursions (ADRs), 
and various types of memory stores (ADS); see Koza et al (1999). 

Finally, it is worth noting that typical operators employed in GP have problems with excessive 
disruption (O'Reilly & Oppacher, 1995). In standard EAs with standard styles of chromosome and 
standard operators, a useful proportion of offspring generated using crossover or mutation from fit parent 
solutions will be at least as fit as their parents. But, in GP, the proportion of such successes is very much 
reduced (which is one reason why GP implementations tend to employ significantly larger populations 
and run for significantly longer than other EAs). Such observations have led to the development of new 
crossover operators, designed to minimise the disruption of good solutions. The typical strategy employed 
by such operators is to restrict the use of crossover to the recombination of similarly structured parents 


(Poli & Langdon, 1997a). 


Recommended Books for GP: 


Genetic Programming: On the Programming of Computers by Means of Natural Selection. 
by John Koza (1992). 


Genetic Programming IT: Automatic Discovery of Reusable Programs. 
by John Koza (1994). 


Genetic Programming III. 
by Koza, Andre, Bennett, and Keane (1998). 


Advances In Genetic Programming 
Edited by Kenneth E. Kinnear, Jr. (Ed.) (1994). 


Advances In Genetic Programming 2 
Peter Angeline and Kenneth E. Kinnear, Jr. (Eds) (1996). 


Genetic Programming - an Introduction 
by Wolfgang Banzhaf, Peter Nordin, Robert E. Keller, Frank D. Francone, (1998). 


Genetic Programming and Data Structures 
by Bill Langdon (1998) 


1.3.4 Evolution Strategies 


Evolution Strategies (or evolutionstrategie) were pioneered in Germany in the 1960s by Bienert, 
Rechenberg and Schwefel (Back, 1996). The first applications of this technique were optimising the shape 
of a bent pipe, drag minimisation of a joint plate, and structure optimisation of nozzles. Somewhat akin to 
Box's ‘Evolutionary Operation’ scheme (see Section 1.2.1) the processors involved in their original 
implementation were biochemical, rather than electromagnetic — physical designs were built, tested and 
mutated by manually altering joint positions or adding and removing segments. 

Fully automated Evolution Strategies began with Schwefel (1965), and continued with Rechenberg 
(1973). This work concentrated on the simplest form of ES, known as the two membered ES. Using the 
terminology we have introduced in describing the GA, we can describe the simplest form of ES as an 
elitist EA with a population size of 1. Naturally, this means that there is no use for a crossover operator, 
and the selection process is somewhat simplified. The entire algorithm works as follows: Beginning with 
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the generation and evaluation of an initial random solution, which will be the first ‘parent’ solution, a 
child solution is generated by randomly mutating the parent, and the child is then evaluated. If the child 
turns out to better than (or equivalently fit as) the parent, then it now becomes the parent and the old 
parent is discarded. Otherwise, the child is discarded. Now, we simply iterate the process. This overall 
scheme is known as a (1+1)-ES. The 1’s stand for the number of parents and the number of children, 
respectively. We'll see later how things work when one or both of these numbers is other than 1. 

There are two other prominent differences between ESs and canonical GAs. Early GAs (but this is 
less common nowadays) tended to use binary chromosomes. That is, a solution to a problem was 
somehow represented as a string of zeroes and ones. Even if the solution was meant to be a list of 
parameter values, the chromosome represented these as binary numbers, and mutation happened at the bit 
level (eg: rather than adding or subtracting an arbitrary small amount to a parameter, we would directly 
flip one of the bits in its binary representation). Early (and most modern) ESs, tend to be applied to 
problems involving strings of real-valued parameters, and the chromosome is a direct list of the 
parameters themselves, rather than a binary version of them. Mutation in an ES involves making small 
additions or subtractions (generally, deviations) to parameters. Such mutations are guided, in the simplest 
ES, by a constant standard deviation parameter. That is, a random number generator is primed to produce 
random deviations according to a Gaussian distribution with a mean of zero, and a fixed standard 
deviation. 

Problems with these early ESs led to certain solutions being developed, which now form the main 
characteristic difference between a typical modern ES and other EAs. This difference is in the inclusion 
of strategy parameters in a chromosome. Basically, with these parameters, the typical deviations applied 
to a gene by mutation can now vary over the course of the algorithm's run, and can also vary with 
different genes. Imagine, for example, a chromosome consisting of five real-valued genes. An example 
such chromosome in a standard EA might be: 


1.25 3.81 4.12 —7.04 0.83 
In a modern ES, however, we will typically encode this solution as 10 ‘genes’, an example being: 
1.25 3.81 4.12 —7.04 0.83 0.1 0.02 0.03 0.34 0.001 
The extra collection of genes encode parameters guiding the sizes of the deviations which will be applied 
to the original genes. In this case, the first five genes correspond directly to parameter values, but the ith 
gene, where i>5, encodes the variance of the deviations which will be applied to the (i-5)th gene. So, in 


future generations, referring to the example chromosome above, rather larger deviations will be applied to 
the first gene than to the second. 
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INITIALISE PARENT POPULATION 
RANDOMLY TAKE TWO PARENTS FROM PARENT POPULATION ~<q—— 


USE RANDOM RECOMBINATION TO GENERATE OFFSPRING IN THE 
CHILD POPULATION 


MUTATE OFFSPRING 


HAS CHILD POPULATION BEEN FILLED WITH NEW OFFSPRING? 
NO 
YES 


EVALUATE ALL CHILDREN TO DETERMINE THEIR FITNESSES 


DETERMINISTICALLY SELECT NEW PARENTS FROM FITTEST OF 
CHILD POPULATION (AND PARENT POPULATION*) AND PLACE 
THEM IN THE PARENT POPULATION 


IS THERE AN ACCEPTABLE SOLUTION YET? 
(OR HAVE x GENERATIONS BEEN PRODUCED?) 


YES 


NO 


FINISHED *for the (4 +4)-ES 


Figure 1.11 The Evolution Strategy. 


More population-oriented ESs soon followed, and the current state of the art (Back, 1996) can be 
captured by the general algorithmic scheme in Figure 1.11. The ES is initialised with a population of 
random solutions, or from a population of solutions mutated from a single solution provided by the user. 
Parents are chosen randomly from the ‘parent population’, and a number of random recombination 
operators are used to generate child solutions, which are placed in the ‘child population’. These operators 
may recombine the values within two parents like the crossover operator of GAs, or they may use a 
parent for every decision variable in the solution. New solutions are then mutated using strategy 
parameters within each solution, and a special scheme is employed to also slightly mutate the strategy 
parameters themselves. Once mutation and recombination has generated enough new individuals to fill 
the child population, these individuals are evaluated to obtain fitness measures, as described earlier for 
GAs. The fittest offspring are then deterministically selected to become parents and these are placed into 
the parent population. With the parent population filled with (mostly) new individuals, the ES randomly 
picks parents from this population to generate new child solutions, which are then evaluated, and so on. 
Evolution terminates after a predefined number of generations, or when a solution of sufficient quality 
has been generated. 

Mutation plays an important role in ES, and is regarded as the primary search operator. Unlike the 
entirely random mutation common to simple GAs and GP, the mutation of ES follows a normal 
distribution; the simple strategy parameters we have discussed so far are used to specify a particular 
normal distribution for each gene — this distribution always has mean zero, and its standard deviation is 
given by the strategy parameter itself. 


Advanced ES 


In advanced ES, another kind of strategy parameter is also employed: a rotation angle a. Depending on 
the number of genes which specify a solution, a suitable number of angle strategy parameters, in addition 
to the deviation parameters, are used to influence the correlation of mutations of one gene with another. 
The result, as illustrated in Figure 1.12 for a simple two-gene case, is that the strategy parameters for a 
solution define a kind of ‘probability hyperellipsoid’ which characterises the effect of mutations on that 
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solution. The strategy parameters thereby influence the direction of search in the search space taken by 
mutation, and by adapting the strategy parameters over time, the ES is able to use mutation to follow the 
contours of the search space and quickly find good solutions. 


DB 


© 


Figure 1.12. Mutation hyperellipsoids defining equal probability density around each solution. In this 
example, each solution has two o parameters and one a@ parameter to guide mutation. Note how 
mutations towards the better area of the search space are encouraged. 


By using strategy parameters in this way — in particular, having them encoded as part of a solution and 
themselves subject to genetic operators — the ES employs a technique known in the general EA world as 
self-adaptation. 

By the early 1980’s, the current state-of-the-art Evolutionary Strategies had been developed (Back, 
1996), known as the (u +A)-ES and (u ,A)-ES (where u is the number of parents and À is the number of 
offspring). These new types of ES now strongly resemble the Genetic Algorithm, by maintaining 
populations of individuals, selecting the fittest individuals, and using recombination and mutation 
operators to generate new individuals from these fit solutions. 

There are some significant differences between ES and GAs, however. For example, although ES 
maintains populations of solutions, it separates the parent individuals from the child individuals. In 
addition, as mentioned above, ES does not manipulate coded solutions like GAs. Instead, like GP, the 
decision variables of the problem are manipulated directly by the operators. Also unlike the probabilistic 
selection of GAs and GP, ES selects its parent solutions deterministically. 

The (u +A)-ES picks the best u individuals from both child and parent populations. The (u ,A)-ES 
picks the best u individuals from just the child population. In order to ensure that a selection pressure is 
generated, the number of parents, u must always be smaller than the number of offspring, A. Back (1996) 
recommends the use of the (u,A)-ES with a parent:offspring ratio of 1:7. 


Recommended Books for ES: 


Evolutionstrategie: Optimierung sechnischer Systeme nach Prinzipien der biologischen Evolution. 
by Ingo Rechenberg (1973). 


Numerical Optimization of Computer Models. 
by H.-P Schwefel (1981). 
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Evolution and Optimum Seeking 
by H.-P Schwefel (1995). 


Evolutionstrategie’94 (volume 1 of Werkstatt Bionik und Evolutionstechnik) 
by Ingo Rechenberg (1994). 


Evolutionary Algorithms in Theory and Practice. 
by Thomas Back (1996). 


Evolutionary Computation : Toward a New Philosophy of Machine Intelligence 2" Ed. 
by David B. Fogel (2000). 


1.3.5 Evolutionary Programming 


Evolutionary Programming was developed by Lawrence Fogel in the early 1960's. Its algorithmic 
form closely resembles that of Evolutionary Strategies, although Evolutionary Programming was 
developed independently (and earlier). The original Evolutionary Programming algorithms were applied 
to the evolution of state transition tables for Finite-State Machines (FSMs). In fact, Evolutionary 
Programming was put forward as a procedure to generate intelligence machine behaviour in the early 
days of Artificial Intelligence. With intelligent behaviour characterised by the ability to predict one's 
environment and to provide a suitable response in order to achieve a given goal, FSMs were viewed as 
flexible general architectures for specifying such behaviour, and hence Fogel developed the idea of 
Evolutionary Programming specifically for the purpose of evolving FSMs. 

In Fogel et al (1966), for example, a sequence of inputs, such as 010001, is presented to an FSM, and 
plays the role of the ‘environment’ within which the FSM is expected to behave intelligently. The FSM's 
task is to predict what the next symbol will be. A single population of solutions was maintained, each 
specifying a state transition table for an FSM, and reproduction used mutation alone. 

Much research was carried out along these lines at New Mexico State University during the 1970s, 
but Evolutionary Programming was either misunderstood or overlooked for several years, until David 
Fogel revisited and redeveloped it in the late 1980’s. There is now a thriving and growing community of 
EP researchers, mainly using D. Fogel's extensions to L. Fogel's original ideas, and applying EP 
successfully to a vast range of practical problems. 


Advanced EP 


David Fogel's extensions of the original EP rendered it applicable to continuous parameter optimisation 
(fixed-length real-valued vectors) and other representations such as permutations for the TSP, and also 
introduced a self-adaptation scheme. Modern EP thus shares much in common with modern ES, but there 
are various technical differences. 

There are three main types of EP in common use: standard EP, meta EP’, and Rmeta EP. These three 
types differ by the level of self-adaptation employed. Standard EP uses no self-adaptation, meta-EP 
incorporates mutation variance parameters in individuals to allow self-adaptation, and Rmeta-EP 
incorporates mutation variance and co-variance parameters into individuals to permit more precise self- 
adaptation (Fogel, 1995). Figure 1.13 shows the working of a general Evolutionary Program. 

Like ES, implementations of EP tend to operate on the decision variables of the problem directly (i.e. 
the search space is the same as the solution space). During initialisation, these variables are given random 
values, often with a uniform sampling of values between predefined ranges. These solutions are then 
evaluated to obtain the fitness values (which in EP may involve some form of scaling or the addition of a 
random perturbation). Next, parents are picked using a specialised kind of tournament selection. 


? Meta EP is now the standard form of EP in use today, and is usually called simply EP. 


34 


Creative Evolutionary Systems 


Tournament selection is commonly used in GAs, and involves a parameter called the tournament size t. 
When f=3, for example, selection of a single parent is done by randomly choosing 3 chromosomes from 
the population, and simply taking the fittest of these (breaking ties randomly) to be the chosen parent. 
Obviously, two applications of this are needed to get two parents for a crossover operation. The 
specialised tournament selection method commonly used in EP, however, adds some sophistication to 
this. In Chellapilla's version (1998), it works as follows. First, a pool of child chromosomes are produced 
via applying mutation operators to the population. Each chromosome in the combined pool (the parents 
and their mutant children) then participates in a tournament with q other randomly chosen individuals. 
Thereby, each chromosome in the combined pool records a number of ‘wins’ (the number of the q 
competitors whose fitness it equalled or bettered). The new parent population is then formed from the 
collection with most wins from the combined pool. The number of individuals in each tournament is a 
global parameter of the algorithm — g=10 is a typical setting. 


INITIALISE POPULATION BY FILLING WITH RANDOM INDIVIDUALS AND 
RANDOMLY MUTATED VERSIONS OF THOSE INDIVIDUALS 


EVALUATE INDIVIDUALS TO DETERMINE THEIR FITNESSES 


RANDOMLY PICK A PARENT BASED ON FITNESS 4 
USING TOURNAMENT SELECTION 


GENERATE CHILD BY MUTATING A COPY OF THE PARENT 
HAS POPULATION DOUBLED IN SIZE? 
NO 
g YES 
EVALUATE ALL CHILDREN TO DETERMINE THEIR FITNESSES 
DELETE THE HALF OF THE POPULATION WITH THE LOWEST FITNESSES 


IS THERE AN ACCEPTABLE SOLUTION YET? 
(OR HAVE x GENERATIONS BEEN PRODUCED?) 


ves 


NO 


FINISHED 


Figure 1.13 The Evolutionary Programming algorithm. 


Children are generated asexually, by simply creating a copy of the parent and mutating it. In a similar 
way to ES, meta-EP and Rmeta-EP ensure that mutation will favour the search towards the areas of the 
search space containing better solutions, by the use of variance and co-variance strategy parameters held 
within individuals for each variable. EP allows mutation to modify these parameters, thus permitting self- 
adaptation to occur. Unlike any of the Evolutionary Algorithms mentioned so far, EP does not use any 
form of recombination operator. All search is performed by mutation, following the assumption that 
mutation is capable of simulating the effects of operators such as crossover, on solutions (Fogel, 1995). 

Child solutions are generated and placed into the population until the population has doubled in size. 
All new solutions are evaluated, and then the half of the population with the lowest fitnesses are simply 
deleted. Parents are then picked, offspring generated, and so on. Evolution is typically terminated after a 
specific number of generations have passed. 

All three types of EP can also be continuous (Fogel and Fogel, 1995), where instead of generating 
offspring until the population size has doubled and then deleting the unfit half, a single individual is 
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generated, evaluated, and inserted into the population, replacing the least fit individual. This replacement 
method strongly resembles that used by steady-state GAs (Syswerda, 1989). 

New advances in EP continue, as this EA is applied to new types of problem. Chellapilla (1997) has 
recently expanded EP to allow it to evolve program parse trees. Various sub-tree mutation operators were 
designed in solving four benchmark problems. He reported that the experiment results showed the 
technique compares well with EAs which use the crossover operator. 


Recommended Books for EP: 


Artificial Intelligence through Simulated Evolution. 
by Fogel, L. J., Owens, A. J., & Walsh, M. J. (1966) 


System Identification through Simulated Evolution: A Machine Learning Approach to Modeling. 
by David B. Fogel (1991). 


Evolutionary Algorithms in Theory and Practice. 
by Thomas Back (1996). 


Intelligence Through Simulated Evolution. 
by Laurence Fogel (1999). 


Evolutionary Computation : Toward a New Philosophy of Machine Intelligence 2" Ed. 
by David B. Fogel (2000). 


1.3.6 Evolutionary Computation Theory 


It should come as no surprise that some (but certainly not all) of the theoretical results in natural 
population genetics also apply to evolutionary algorithms. The field of Evolutionary Genetics (see 
Maynard Smith, 1989) deals with issues such as the spread of favourable genes, selection pressure, 
migration between populations, and several other issues which concern EA practitioners. There are many 
differences between the natural evolution and computer evolution studies, however, which mean there is 
little crosstalk between the two fields in terms of theory. The main difference is one of emphasis — a 
researcher of natural evolution will tend to look for predictions and explanations about the spread of 
favourable or unfavourable genes given certain underlying mutation rates, for example. An EA developer, 
however, will be much more interested in how best to set up a range of parameters so as to most 
effectively attack a specific problem. Partly, this might involve designing specialised operators for the 
problem in hand, and/or defining specialised genotype-phenotype mappings — but in natural evolution, 
these aspects are ‘givens’. 

However, certain interesting general findings apply, which to some extent have been rediscovered 
and/or specialised by EA theorists. For example, Price (1970) produced a ‘Covariance and Selection’ 
theorem for population genetics, which identifies how the average fitness of the population (or perhaps 
other measures) will change from one generation to the next, essentially based on the extent to which 
parents' fitnesses correlate with children's fitnesses. 

It is worth taking a look at Price's theorem in a bit more detail. The key aspect of the theorem is that 
it explicitly identifies the covariance of parent and child fitnesses as an important factor. Covariance is a 
simply defined mathematical concept. Assume for simplicity that we are only dealing with mutation 
operators, and that we denote chromosomes by 41,x2,x3,etc ..., and their fitnesses by 


f(x), f (x2), f (x3),and so forth. Assume further that we have a set P of parent chromosomes, and a set 
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C of child chromosomes, in which each child c; EC is a mutant of parent x; EP . The covariance (also 
called the correlation coefficient) of the parent and child fitnesses is the following number: 


T SOD -4m (Ci) -cn) 


where xmis the mean fitness of the parents, and cmis the mean fitness of the children. If there is 
absolutely no correlation between a parent's fitness and the fitnesses of its potential children (i.e., 
inheritance means nothing), then the covariance will be around zero. If parents tend to have children with 
the same fitnesses as themselves, then covariance will be close to 1. If children tend to ‘rebel’ — fit 
parents have unfit children, and vice versa — then covariance will be negative, and reach —1 at the extreme 
of rebelliousness. 

It is easy to see how crucial this measure is in any evolutionary system. For example, imagine we are 
trying to evolve a nice melody, using a collaborative system in which a human listens to each of 
population of computer-generated melodies and identifies just a few of them as good parents which the 
computer will then use to generate the next batch. If there is strong negative covariance between parent 
and child fitnesses, then this method of selection will be counter-productive — all that the user has done is 
pick out precisely those chromosomes whose children will be pretty poor! In fact, assuming that the 
system does nothing sensible to avoid it — such as making sure the best few are always retained in the 
population — the population of melodies will simply get worse and worse. If instead there was no 
correlation at all between parent and child fitnesses, we can expect selection to have no effect at all. 
There is no difference in the kinds of fitnesses we can expect from the children of fit versus unfit parents. 
The more usual situation, of course, is that there is a positive covariance. That is, fit parents tend to have 
fit children, and poor parents tend to have poor children. So, to have a good chance of finding things 
which improve on the best fitness so far, it makes sense to focus on fitter parents — in other words, it 
makes sense to use a selection and reproduction strategy which implements the ‘survival of the fittest’ 
idea. 

Price's theorem is special in that it makes all this mathematically explicit and clear, and (with 
only minor reservations) applies equally well to natural and computer evolution. With lots of notation cut 
away, we can simplify the theorem itself to the following statement: 


Fisi = Rei +C: 


in which F;4; denotes the mean fitness of the population in the next generation, R;+; is the mean 
fitness we would expect in the next generation if there was no selection pressure (i.e.: if parents were 
selected entirely at random), and C; is the covariance measure we have already discussed. So, imagine we 
have a positive correlation between parent and child fitnesses; R;+1 can certainly be expected to be no 
smaller than F; , and so the theorem clearly indicates that fitness will improve from one generation to the 
next. Better still, Price's theorem need not refer to fitness per se. F, could be any measure of the 
population we like, such as the proportion of chromosomes with a certain gene. 

Although Price's theorem is very general and at least assures us that our populations will tend to 
improve over time, EA researchers and practitioners tend to demand more from the theoreticians in the 
field; in particular, it would be nice to know if we could be sure that an EA would always produce a result 
within a certain amount of the best possible solution, and how to set up the parameters of an A to ensure 
this. Well, there is no proof that even the simplest GA will always converge to an acceptable solution to 
any given problem in finite time. The most well known attempts so far to theoretically understand 
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evolutionary algorithms, and to build foundations upon which such questions may be addressed, are 
based on Holland's Schema Theorem (Holland 1975) and the associated Building Block Hypothesis 
(Goldberg, 1989). A variety of alternatives exist (e.g.: Kargupta 1993, Harris 1994), but we will say a 
little here about the Schema Theorem, since it is a widely used and accessible route towards 
understanding the behaviour of certain EAs. 

A schema is a ‘similarity template’ which describes a set of chromosomes. For example, if our 
chromosomes are binary strings of length five, then the schema 1*011 describes (or ‘matches’) the set of 
two strings {10011, 11011} — hence, the ‘*’ is interpreted as a don't care symbol. The schema *101* 
describes four strings {01010, 11010, 01011, 11011}. In general (Goldberg, 1989) for alphabets of 
cardinality (number of characters allowed per gene position) k, and string lengths of /, there are (k + iy 
possible schemata. 

The order of a schema is the number of fixed characters in the template, e.g. the order of schema 
*1*110 is 4, and the order of schema *****0 is 1. The defining length of a schema is the distance 
between the first and last fixed character in the template, e.g. the defining length of 1****0 is 5, the 
defining length of 1*1*0* is 4, and the defining length of 0***** is 0. Finally, we can associate a fitness 
with any schema. The fitness of a schema is simply the average fitness of the chromosomes in the set it 
describes. For example, the fitness of 10111 is simply the fitness of the chromosome 10111 itself. But the 
fitness of 1*101 is the mean of the fitnesses of the two chromosomes 10101 and 11101, 

Holland's Schema Theorem states that the action of reproduction (copying, crossover and mutation) 
within a Genetic Algorithm ensures that schemata of short defining length, low order and high (relative) 
fitness increase within a population (Holland, 1975). Such schemata are known as building blocks, and 
the building block hypothesis (Goldber, 1989) suggests that Genetic Algorithms are able to evolve good 
solutions by processing building blocks, and in particular by making use of crossover to combine 
different building blocks to occasionally produce considerable improvements in fitness. It turns out (see 
Altenberg, 1995) that this is a special case of Price's Covariance and Selection Theorem. As long as 
building block fitness is positively correlated with chromosome fitness, we can be sure that good building 
blocks will increase in number from one generation to the next, 

There is one major difficulty with this theorem, however, and naturally with Price's theorem too. All 
that can be said is what will happen from generation to the next — that is, what the generation at step ¢+1 
will be like given lots of information about the generation at step t. The problem is that the terms on the 
right in Price's theorem (see above) are far from constant. The covariance between parent and child 
fitnesses, for example, may be entirely different at generation t+1. It is easy to see this if we consider 
what Price's theorem has to say concerning a population in which all chromosomes already have the best 
possible fitness. Obviously, fitness cannot improve in future generations in this circumstance, and this is 
clearly because there is now a negative covariance, caused by the fact that no child will be fitter than its 
parent, but many will probably be less fit. The awkward fact is that we can expect the covariance term 
and the ‘random’ term to both vary at every generation; whether we are talking about fitness or building 
blocks, this fact rather limits the general applicability of Price's theorem and the Schema theorem. 

Nevertheless, sophisticated theoretical research to investigate the behaviour of the various varieties 
of EA for different problems is growing rapidly, and making progress. For example, careful analyses of 
the transmission of schemata have been made (De Jong 1975, Kargupta 1993), and the use of Walsh 
function analysis (Deb et al. 1993) and Markov Chain analysis (Horn 1993) has led to the identification 
of some 'deceptive' and ‘hard' problems for GAs (Deb and Goldberg 1993). In Chapter 4 of Evolutionary 
Design by Computers (Bentley, 1999a), David Goldberg summarises some of the significant advances in 
the understanding of GAs made to date. 

Because there are significant differences between the representation and operators of GP and other 
EAs, it is unclear whether Schema Theorem type analyses can be applied to GP. Koza (1992) attempts to 
achieve this by defining a schema to be the set of all individual trees from the population that contain, as 
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sub-trees, one or more specified sub-trees. So for GP, disruption is smallest and the deviation from the 
optimum number of trials is smallest when the schema is defined in terms of a single compact sub-tree 
(Koza, 1992). As long as crossover is not too disruptive, the fittest of such compact sub-trees should 
exponentially grow within the population, and be used as building blocks for constructing fit new 
individuals. Unfortunately, it seems that crossover in GP is often too disruptive for such theories to be 
applicable. Definitions of schema and the Schema Theorem are still the subject of much research in the 
GP community (O'Reilly and Oppacher 1995, Poli and Langdon, 1997b). 

Theoretical studies centred on ES and EP have tended to be quite independent of schemata-style 
analysis, instead concentrating on how to set up parameters such as mutation rate, and how best to 
organise self-adaptation. The theoretical roots of ES were developed in the 1970’s, and apply largely to 
the simplest form of the algorithm, in this case the (1+1)-ES with no self-adaptation. Rechenberg 
analysed the convergence rates of ES for two test functions, and calculated the optimal standard deviation 
and probability values for a successful mutation regime. From this he formulated the 7/5 success rule: 


The ratio of successful mutations to all mutations should be 1/5. If it is greater than 1/5, increase the 
standard deviation, if it is smaller, decrease the standard deviation. (Rechenberg, 1973). 


Born (1978) subsequently formally proved that this simple form of (1+1)-ES will result in global 
convergence as long as there is a positive standard deviation. Other theoretical analyses have shown that 
the introduction of populations in ES causes a logarithmic speedup in evolution over the simple (1+1)-ES 
(on strongly convex functions). 

As Back (1996) describes, Schwefel derived an approximation theory for the convergence rate of the 
simplified (u,A)-ES and (u +A)-ES (one standard deviation for all object variables; no crossover nor self- 
adaptation). More recently, Rudolph (1996, 1997, 1998) has used Markov chains to investigate the 
convergence theory in EAs. 

Although ES theory can be applied with little modification to EP (Back, 1996), Fogel has performed 
independent analyses of various forms of EP, finding that mutations should increment or decrement the 
value of a decision variable by no more than the square root of the fitness score of the solution. Fogel also 
proved that simple EP will converge with a probability of one, however convergence rates (time taken to 
converge) and other significant features of EP remain unsolved. Interested readers should consult (Fogel, 
1992b). Recent theoretical and empirical work by Yao and Liu (1996) has identified an alternative type of 
mutation operator to use within EP — this uses a Cauchy instead of Gaussian (normal) distribution of 
deviations, essentially meaning that although there remains much higher chance of small deviations, large 
deviations will be much more common than with the Gaussian operator. In (Yao, Lin and Liu, 1997), an 
analysis based on the study of neighborhood and step size of the search space is performed to compare 
these two mutation operators. Their work provides a theoretical explanation, supported with empirical 
evidence, of when and why Cauchy mutation is better than Gaussian mutation in EP search. The long 
jumps provided by Cauchy mutation increase the probability of finding a near-optimum when the 
distance between the current search point and the optimum is large. The Gaussian mutation, on the other 
hand, is a better search strategy when the distance is small. 

A study by Gehlhaar and Fogel (1996) also indicates that the order of the modifications of object 
variables and strategy parameters has a potentially strong impact on the effectiveness of self-adaptation. It 
is important to mutate the strategy parameters first and then use them to modify the object variables. In 
this way, the potential of generating good object vectors that are associated with poor strategy parameters 
can be reduced. Thus the likelihood of stagnation can be reduced. 

Experimental comparisons between the different types of EP are ongoing. For example, EP with self- 
adaptation has now been reapplied to the original task of evolving FSMs (Fogel et al., 1995, Angeline et 
al., 1996). Each state in a FSM was associated with mutation parameters to guide which component of the 
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FSM was to be mutated and how to perform the mutation. Angeline et al. (1996) reported that EP with 
self-adaptation performs better than a standard EP when solving a predication problem. 

Finally, while theoretical studies are necessarily attuned to simple EA designs and usually unrealistic 
test problems, extensive empirical studies have revealed many things which seem to be generally true of 
all EAs and most real-world applications. For example, evolution tends to make extremely rapid progress 
at first, as the diverse elements in the initial population are combined and tested. Over time, the 
population begins to converge, with the separate individuals resembling each other more and more 
(Davis, 1991). Effectively this results in the EA narrowing its search in the solution-space and reducing 
the size of any changes made by evolution until eventually the population converges to a single solution 
(Goldberg, 1989). When plotting the best fitness value in each new population against the number of 
generations, a typical curve emerges, such as Figure 1.14 (Parmee and Denham, 1994). 


fit A 
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Figure 1.14 Typical curve of evolving fitness values over time. 
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1.3.7 Generalised Evolutionary Algorithms 


The perceptive reader should be able to see that the four major types of Evolutionary Algorithm we have 
discussed are really just points in an infinitely large space of possible evolutionary algorithm designs. The 
division of the evolutionary computation field into these four distinct areas has arisen for historical 
reasons, but there is certainly no reason to believe that the ‘best’ EA for a particular problem is closer to 
one of these four points than to another. These days, a modern breed of evolutionary computation 
researchers are assiduously exploring the space of EA designs and thereby producing algorithms which 
do not neatly fall into either of the four main groups. This may be because aspects of two or more types 
of EA are combined — for example, using an EP-style algorithm to evolve tree-structured programs, such 
as Chellapilla (1997) — or because the algorithm is simply radically different from any of the major four, 
such as the Population Based Incremental Learning algorithm (Baluja & Caruna, 1995). In (Bentley, 
1999c), an attempt is made to outline the dimensions of this space of possible EA designs in the context 
of a General Architecture for Evolutionary Algorithms (GAEA). Here, we rapidly summarise the shape of 
the GAEA, and extend it a little. 

We start by noting what all points in EA design space should have in common. As stated by the 
theory of Universal Darwinism (Dawkins, 1983), necessary criteria for evolution to happen are the 
presence of reproduction, inheritance, variation, and selection. That is, any point in EA design space 
must represent an algorithm in which new individuals can be generated (reproduction), these new 
individuals are often largely similar to old ones (inheritance), but with some differences (variation), and 
there is some bias towards inheritance from ‘better’ individuals (selection). 

Selection, in particular, is both critical to the success of an EA (i.e., without selection, there is no 
force to drive the population towards improving fitness), and can be implemented in such an algorithm in 
several ways. Consider the real-world process of selective cattle breeding, for example. We can 
implement selection either by making sure we only allow better cows to breed, or by letting all cows 
breed, but ruthlessly culling low-milk yield calves, or both. (If we could change the number of calves 
produced by a cow each time, we would also have a third way to induce selection pressure.) Something 
akin to the former technique is what ‘selection’ tends to denote in the EA world, but EAs may use all of 
these techniques. 

Points in EA design space will also all share certain other features. Namely, there will be some way 
of initialising the population, some way of evaluating the fitness of candidate solutions, and some way of 
determining when to stop. In other words, dimensions in the space of EA designs will include 
initialisation, evaluation, and termination. 

There are two further, less obvious, dimensions in which points in EA design space may vary which 
are part of Bentley's (1999c) GAEA. These are mapping and moving. Mapping refers to the distinction 
between phenotype and genotype. At first sight it may seem sensible to simply package this up with the 
term evaluation, since in all cases we expect the evaluation function to somehow ‘decode’ the genotype 
(thus finding the phenotype it maps onto), and then calculate the fitness of that phenotype. However, 
emerging areas in the EA world such as embryology are looking into very sophisticated 
genotype/phenotype mappings, allowing highly complex solutions to be specified using a compact set of 
instructions. Certainly, the mapping stage may vary independently of the fitness calculation, hence its 
presence as a standalone feature of the GAEA. 

The moving dimension refers to the organisation of population dynamics. It has been found highly 
successful to structure a population of chromosomes into independently evolving subpopulations 
(Whitley & Starkweather, 1990) or localised, overlapping subpopulations (see Collins & Jefferson, 1991; 
Davidor, 1991), in which separate parts of the population evolve (semi)-independently, but occasional 
migration moves chromosomes from one part of the population into another. This allows separately 
evolving individuals to occasionally share useful genetic information, reducing premature convergence 
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within species, reducing the number of evaluations needed, and improving the quality of solutions 
evolved. 

There are two further important dimensions in which evolutionary algorithms can vary, and which 
we herein add to the GAEA architecture of Bentley (1999c). These can be called operator adaptation, 
and restart. A typical applied EA — that is, one which has been carefully designed and tailored towards 
addressing a particular application — might use a large collection of specialised crossover and mutation 
operators. A problem arises (in all EAs, but much moreso here) regarding what are called the ‘operator 
rates’ — i.e.: how often to apply each individual operator? A suitable answer to this problem is to let the 
algorithm work it out, That is, the rates of application of an operator will evolve and adapt over time, 
changing according to their current level of success or failure. There are many possible schemes for this 
adaptation process (see Tuson & Ross, 1998). Finally, restart refers to a scheme employed by an 
algorithm to effectively start again when the population seems not to be getting anywhere, but not quite 
from scratch, before its time is up. The well-known GENITOR II algorithm (Whitley & Startkweather, 
1991) employed a specific restart mechanism, whereas in the CHC algorithm (Eshelman, 1991, and also 
see Chapter 14), the restart method is central to the algorithm, being the only place in which mutation is 
ever applied. 

In summary, a generalised evolutionary algorithm will have something to say (although in some 
cases there may be nil returns) about each of the following components: initialisation, mapping, 
evaluation, selection, operator adaptation, fertility, reproduction, restart and termination. Most of these 
stages are described much more fully in Bentley (1999c). Here, our goal is simply to give some idea of 
the massive degree of unexplored territory in the space of possible Evolutionary Algorithm designs. It is 
unknown whether or not there are particularly fruitful but as yet untouched regions of this space, but its 
size seems to suggest (unless significant advance in theory can obviate it) that research in this area will 
take quite a while to fizzle out, if ever! 


1.3.8 From Evolutionary Algorithms to Creative Evolutionary Systems 


This section of the chapter has introduced the concept of using computers to search for good solutions in 
a search space. The parallel searching mechanism used by Evolutionary Algorithms was described, and 
the four major EAs were summarised: Genetic Algorithms, Genetic Programming, Evolution Strategies, 
and Evolutionary Programming. The section concluded by briefly describing a General Architecture for 
Evolutionary Algorithms, emphasising that all EAs are fundamentally points in a very large space of 
potential EA designs. 

Having now explained how computers are used to perform evolution, the following section describes 
how we can make computers creative by using evolution, and how evolution can help us to be creative. 
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1.4 Creative Evolutionary Systems 


1.4.1 Introduction 


Using evolution as a simple function optimiser is one thing, but how do we enable evolution to handle 
creativity? What is a creative evolutionary system, anyway? 

Put simply, a Creative Evolutionary System is a computer system that makes use of some aspect of 
evolutionary computation and is designed to: 


. Aid our own creative processes, and/or 
° Generate results to problems that traditionally required creative people to find solutions. 


In achieving these goals, a creative evolutionary system may also appear to act ‘creatively’. For 
example, a system might find highly innovative and novel solutions, or it might combine two very 
different ideas to make something new. The debate on whether evolutionary computation is really 
creative or not will be presented in the last section of this chapter, but first we must explore creative 
evolutionary systems. 

Again it is worth stressing that such systems are not intended to replace people, but are to increase 
productivity and creativity by allowing people to explore more and a wider variety of solutions than they 
could without such computer systems. We will first look in more detail at how and why these techniques 
were developed. 


1.4.2 Background 


Many of the advances in creative evolution grew up in the field of evolutionary design (Bentley, 1999a). 
It is easy to see why this has happened. Design problems such as architecture, engineering design, and 
aesthetic design are horribly complex, with huge numbers of (often conflicting) objectives, many 
constraints and often thousands of parameters (Parmee, 1999). But the most difficult aspects of these 
design problems are people. Designs are usually used by people - we live in architecture, we use and 
interact with the things around us. We like and dislike things almost at random, and as fashions change, 
so our preferences and requirements change. This means that a design specification will usually be a 
moving target (French, 1999). It will have many unknowns, and the few things that are true one week will 
not necessarily be true the next week. 

Designers take such things for granted. They know that their designs will be revised and modified 
many times until clients are satisfied (or until time or costs prevent further changes). And architecture is 
perhaps the most extreme type of design in this respect. There are so many different rules, opinions, 
preferences and materials that for every new building, that there will be an infinite number of possible 
design solutions. Exploring these solutions forms part of the difficult job of being an architect. 
Consequently, it is no coincidence that the first forays into explorative and generative evolutionary design 
were made by architects. Some of the earliest work was performed by Prof. John Frazer, who spent many 
years developing evolutionary architecture systems with his students (Frazer, 1995). He showed how 
evolution could generate many surprising and inspirational architectural forms, and how novel and useful 
structures could be evolved. His methods often involved the use of brick-like components such as cellular 
automata, which were evolved and sometimes wrapped in surfaces to generate smooth exteriors. His 
chapter Creative Design and the Generative Evolutionary Paradigm describes some of these in more 
detail. In Australia, the work of Prof. John Gero and colleagues such as Dr. Michael Rosenman (both 
architects) also investigated the use of evolution to generate new architectural forms. This work 
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concentrates on the generation of new floor-plans for buildings, showing over many years of research 
how explorative evolution can create novel floor-plans that satisfy many fuzzy constraints and objectives 
(Gero & Kazakov, 1996). They even show how evolution can learn to create buildings in the style of 
well-known architects (Schnier and Gero, 1996). 

Designers and architects still remain at the forefront of this area of research. Today increasing 
numbers are creating evolutionary architecture systems capable of generating novel forms, structures, 
buildings and even towns. For example, Paul Coates of the University of East London has shown how 
evolution can generate coherent plans for housing estates and buildings, as well as innovative building 
exteriors (Coates, 1997). Prof. Celestino Soddu of Italy uses evolution to generate everything from novel 
table-lamps to castles to three-dimensional Picasso sculptures (Soddu, 1995), see his chapter 
Recognizability of the Idea: The Evolutionary Process of Argenia. The work of Dr. Ian Parmee at the 
University of Plymouth has revealed a variety of methods for handling the complex and fluid nature of 
engineering design problems over the years (Parmee, 1999). 

Artists are also keen researchers into creative evolutionary systems. Dawkins’ “biomorphs’ inspired 
the well-known work of William Latham and Stephen Todd, who had considerable success in evolving 
artistic images and animations (Todd & Latham, 1999). The work of Karl Sims was also inspired by 
Dawkins, and also showed the astonishing complex and aesthetically pleasing images that evolution 
could generate (Sims, 1991). Evolutionary art systems have now become very popular, with many 
programs available and some now being incorporated into art and CAD packages (Rowbottom, 1999). 
For more details, see the section on evolutionary art in this book. In addition, Mitchell Whitelaw explores 
more of these in his chapter Breeding Aesthetic Objects: Art and Artificial Evolution. 

It is interesting to note that all of these examples of evolutionary systems used evolution more as an 
explorer than an optimiser. Normally guided by a human, the software is used to investigate many 
possible solutions, to provide inspiration and to give a feel for the range of useful solutions. 

Whilst producing impressive results, such software always received some criticism that the presence 
of a human to guide the direction of search by evolution was the key to the success of these systems. 
Peter Bentley’s work in this area, and the work of others such as Adrian Thompson and John Koza, 
provided some of the first convincing demonstrations that evolution was capable of innovation without 
human guidance (the second type of creative evolutionary system). Bentley showed how evolution would 
find surprising and creative solutions to design problems, even when only software guidance was 
provided. By telling the computer the desired function in the form of a set of evaluation routines, but not 
anything about the design itself, the human was removed from the loop and the power of explorative 
evolution was shown conclusively (Bentley & Wakefield, 1995, 1997a,b; Bentley, 1996). Adrian also 
demonstrated the power of evolution, this time to generate novel electronic circuit designs which were 
tested using field programmable gate arrays (Thompson, 1995). His chapter, The Sound Gallery - An 
Interactive A-Life Artwork, explains how these techniques can be used to generate music. In a similar 
vein, John Koza has been demonstrating the use of genetic programming to find novel computer 
programs for some years, i.e. to use computers to program themselves (Koza, 1992). Work such as this 
began the recent change in thinking about evolution. No longer were we content to regard an evolutionary 
algorithm as ‘another optimiser’. Our evolutionary programs were now independently solving problems 
for us, and finding creative solutions that surprised us. 

Since then, research in this area has expanded rapidly. Adrian Thompson spends his time trying to 
develop ways to analyse how his evolved circuits work (Thompson & Layzell, 1999). Julian Miller has 
expanded upon Thompson's work, showing how evolution can create circuits that seem to work on 
entirely new principles (Miller et al, 1999) - see his chapter The Genetic Algorithm as a Discovery 
Engine: Strange Circuits And New Principles. John Koza has announced the completion of a 1000- 
processor Beowulf supercomputer which will be used for the sole purpose of ‘using genetic programming 
as an automated “invention machine” for creating new and useful patentable inventions’ (Koza, 1999). 
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His group has recently demonstrated the use of evolution to generate many different types of analogue 
circuit, many of which mirror or outperform our best human-created circuit designs (Koza et al, 1999). 
The chapter, Genetic Programming: Biologically Inspired Computation that Exhibits Creativity in 
Producing Human-Competitive Results provides more information on this. Jordan Pollack has shown how 
evolution can generate highly novel structures such as bridges and cranes (Funes and Pollack, 1999) and 
has now begun to use these methods for the evolution of robot bodies, as described in his chapter 
Evolutionary Techniques in Physical Robotics. Karl Sims used evolution to create the bodies and brains 
of ‘virtual creatures’ capable of swimming, walking, jumping and competing in virtual environments 
(Sims, 1999). Husbands et al (1996) used evolution to generate novel propeller-like forms. Many research 
departments around the world use evolution to generate new and highly complex neural networks for 
various applications. Bentley’s work in this area continues, as he uses evolution to compose music that 
cannot be distinguished from human compositions (Bentley, 1999b). 


Now we have a feel for the whys and hows of creative evolutionary systems, let’s look a little more 
closely at the two types. We have seen that these systems can aid our own creative processes, and can 
generate results to problems that traditionally required creative people to find solutions. Let’s first 
examine more closely how evolution can be used to aid our creativity. 


1.4.3 Aiding Our Creativity 


Richard Dawkins was one of the first to show the world how evolution on a computer could be combined 
with the aesthetic preferences of a user to generate an almost infinite array of pleasing or interesting 
forms (Dawkins, 1986). But this form of creative evolutionary system has been in existence long before 
computers were ever invented. Horses, cows, sheep, dogs, cats, guinea pigs, birds, wheat, corn, roses, 
trees - all belong to the enormous list of 'creatively modified' forms of life. Through selective breeding, 
where a person selects the parents of each generation based on his/her aesthetic judgement or functional 
requirements, we have enabled evolution to generate a wide range of imaginative, beautiful (and 
sometimes ugly) forms. In both nature and computer science, evolution provides us with the novelty, 
showing us new and subtly different solutions every generation. We act as the judge for this kind of 
creative evolutionary system, choosing some solutions with certain features, rejecting others. As we 
watch, we see innovations and mistakes unfold before us, and our imagination, our creativity is engaged. 
The partnership of evolution and the human judgement enables a richer and more diverse kind of 
creativity. 

This, then is the essence of this type of creative evolutionary system. The user of the system is the 
judge, who chooses the short-term path of evolution. With real persistence, the user may be able to make 
the right choices to reach a specific final goal, but usually in most of these systems the user quickly 
becomes a very reactive decision-maker, basing their choices on what they see immediately in front of 
them and not on what they hope they might end up with. This is only natural, for it is evolution that 
provides the choices, and although it might eventually provide every solution possible, it rarely gives the 
user an expected result. And it is this very feature that makes creative evolutionary systems so useful. If 
the user already knows what they would like to see, it is rare for an evolutionary system to be needed in 
order to obtain it (Peter Hancock provides the exception to this in chapter 17, Evolutionary Generation of 
Faces). Normally it is the very unpredictability of evolution that helps stimulate the creativity of people. 
By constantly throwing up unexpected and unlikely solutions, the user is forced to react, change their 
minds, explore new possibilities. This type of creative evolutionary system can enhance the creativity of 
people. 
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Collaborative Evolutionary Algorithms 


So we make this kind of creative evolutionary system by adding human interaction to the evolutionary 
process. Our judgement must contribute to or replace the fitness functions (or any other part of the 
evolutionary algorithm that helps generate selection pressure). When we modify EAs in this way, we call 
them interactive evolutionary algorithms, or collaborative evolutionary algorithms. 

There are a large number of different approaches used in this area. For example, Furuta (1995) 
allowed users to judge the aesthetics of evolving bridges in addition to their structural evaluation, and 
employed ‘psychovectors’ to quantify aesthetic factors. Others use multiobjective optimisation methods 
to combine user input and fitness functions (Bentley, 1999a), some use fuzzy logic to aid the input of 
knowledge into the search (Parmee & Bonham, 2000). Most evolutionary art systems will present users 
with some or all of the evolving population, and allow them to rank or vote on the quality of the images 
(Rowbottom, 1999). Some, like the system described in Adrian Thompson’s chapter in this book, even 
allow users to ‘vote with their feet’ and physically move themselves towards evolving solutions that they 
prefer. 

By adding human guidance into evolutionary search we gain certain advantages, but also incur 
certain problems. The advantages include: 

e Good searching ability — if evolution seems to ‘get stuck’ (converge) on a certain type of solution, 
the users can alter their guidance and force evolution to try alternatives. 

e A wide range of different solutions — the longer users ‘play’ with such systems, the more solutions 
they will see. 

e The ability to evolve solutions for which there is no clear fitness function — if you cannot work out 
why something looks nice, sounds good, or is fashionable, you cannot use software evaluation to 
automate the fitness evaluation. Also, if the objectives are highly variable as well as being 
subjective, human interaction permits quick re-evolution without the need to rewrite fitness 
functions. 


The disadvantages of collaborative systems include: 

e Speed — humans can only judge solutions at a very slow rate, so evolution may take rather longer. 

e Consistency — humans often change their minds, get distracted, bored or become influenced by other 
solutions, so they will not judge solutions consistently. 

e Coverage — in order to provide effective guidance, users need to judge most (or ideally all) different 
solutions in an evolving population. But for hard problems, large population sizes and many 
generations may be required. Humans simply cannot cope with the thousands of evaluations that are 
necessary for a typical evolutionary run. 


Of course, it is also very important to have a good representation that enables evolution to find and 
define a huge range of alternative solutions — we will look at issues of representation later. But the 
addition of user input into an evolutionary algorithm is so easy, and the results often so good, that it is 
surprising how few researchers actually permit it. To illustrate how simple it can be, Bentley’s genetic 
algorithm designer, GADES (Bentley, 1999a) was modified for this chapter. A new evaluation module 
was added which simply presented each member of the evolving population to the user in turn, and asked 
for a fitness score to be input (a number between 0 and 9). With a population size of ten individuals, 
slightly higher mutation rates than normal (to slow convergence) and about 30 or 40 generations, a wide 
variety of ‘interesting solutions’ were evolved. Because of the time needed to judge the solutions, each 
took around half an hour. Figure 1.15 shows how creative the results of evolution were, when combined 
with human guidance. 
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Figure 1.15 ‘Aesthetically pleasing’ (or at least interesting) shapes evolved by the interactive 
GADES. 


1.4.4 Generating Creative Results 


The second way in which these systems can aid creativity is by taking over more of the role of the 
creative person and actually providing solutions to a problem automatically. It is hard to automate the 
judgement of aesthetic preferences (although it can be done in a limited way), but we have had 
considerable success in evolving solutions that fulfil a desired function. We can now evolve aerodynamic 
cars, highly novel circuit designs, architecture and music without the need for constant human guidance. 
This allows more solutions to a problem to be found quicker, and also provides inspiration and 
information about what kinds of solution exist for the user. Problems of ‘design fixation’ are removed, 
and radical new and more efficient concepts can be found quicker. 

Why is this such a big deal? We have been optimising solutions for many years, and no-one has 
claimed anything about ‘creativity’ before. The difference is two-fold - first, we are now enabling 
evolution to find solutions to problems that traditionally have always been regarded as something of an 
art form - whether composing music or designing analogue circuits. To claim that evolution can now 
perform as well as the experts for some of these applications is heresy to many people, but as the chapters 
in this book show, it is beginning to become true - see chapter 11. The second difference is the way we 
apply evolution to these problems. Instead of providing an existing solution which is then optimised, most 
creative evolutionary systems only provide the tools to build new solutions, allowing evolution to 
discover novelty and innovation by itself. And it turns out that this is rather useful, for the kinds of 
solution that evolution discovers are often very different to the kinds of things we think of. 
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Making Evolution More Creative 


So how can evolution achieve these marvels? We will discuss exactly what it means to be creative in the 
last section of this chapter, but one common definition of creativity is removal of constraints. 

It is no coincidence, then, that when we examine how creative evolutionary systems differ from more 
traditional evolutionary systems, we see that constraints of one form or another have been relaxed or 
removed. Some researchers do this quite explicitly - for example the recent work of Ian Parmee 
concentrates on the development of interactive evolutionary systems that allow users to relax functional 
constraints for engineering design problems. As Ian states, “...close individual designer and design team 
interaction with evolutionary and adaptive computing strategies can result in significant exploration 
involving off-line processing of initial results and related design information leading to a redefinition of 
the design environment.” (Parmee & Bonham, 2000). In other words, the intention is to allow designers 
to relax constraints in order to explore more potential solutions. Then with this additional knowledge 
designers can redefine representations and allow evolution to provide newer or different solutions more 
appropriate for the application. But there are other, more important constraints that must be considered if 
we are to enable creative evolutionary systems to generate novelty. 

Traditional implementations of evolutionary search suffer from the same fundamental drawbacks as 
all conventional search algorithms. They rely on a good parameterisation to permit them to find a good 
solution. If we are optimising a propeller blade, but the parameterisation does not permit the width of the 
blade to vary, then the computer will never be able to find solutions with different widths. If there is no 
parameter for something, then the computer cannot modify it. Evolution, like all search algorithms, is 
limited and constrained by the representation it can modify. So it is clear that while relaxing functional 
and parameter constraints will permit evolution to arrive at a larger diversity of solutions, only by 
modification of the representation can evolution go beyond optimisation. It seems that the remarkable 
results obtained by this type of creative evolutionary system require the removal of constraints within the 
representations, and not only the fitness functions. And by using a different type of representation, we can 
cause this to happen automatically. 


Component-based representations 


Traditional views of an evolutionary algorithm regard this search technique as an optimiser. A better 
term is actually ‘satisficer’ (Harvey, 1997). Evolution never tries to find globally optimal solutions. It 
merely propagates improvements through the population. In doing so, evolution walks a mysterious and 
winding path through the search space. Sometimes this path may reach a dead-end (premature 
convergence). Sometimes the path may go around in circles. And occasionally the path may lead to a 
global optimal - but there is no guarantee of this. The wanderings of evolution are like those of an 
explorer. 

But exactly what does evolution explore? This is determined by the representations it uses. With a 
fixed-length parameterisation, explorations do resemble optimisation. For example, if there are only three 
parameters defining the solution and a single fitness function, evolution will naturally behave in much the 
same way as an optimiser - it will find the best values for those three parameters such that the solutions 
are as fit as possible. But with a different kind of representation, the behaviour of evolution changes. 
When the parameters do not define the solution directly, when they define a set of components from 
which the solution is constructed, the idea of optimisation becomes inappropriate. Now evolution 
explores new ways of constructing the solution by changing the relationships between components. It can 
vary the dimensionality of the space by adding or removing elements. It can explore alternatives instead 
of optimising a single option. When we examine the representations, objectives and goals of optimisation 
and exploration, the difference between these approaches becomes clearer: 
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Optimisation 

A knowledge-rich encoding of the problem is used, i.e. a solution is parameterised using the fewest 
possible parameters (and thus both minimising the search space, but also minimising potential for 
exploration). Evolution is used only to find the best parameter values within that parameterisation. 
Objective functions are normally predefined and fixed. The goal is to find a global optimum or near 
global optimum with the least amount of computation. 


Exploration 

A knowledge-lean representation is used, and instead of a parameterisation of a solution, a set of low- 
level components is defined. Solutions are then constructed using the components, allowing exploration 
(sometimes at the expense of size of search space and ability to locate optima). Objective functions may 
vary at any time. The goal is to identify new and interesting solutions - normally more than one is 
desirable - and these solutions must be good. However, finding global optima may be undesirable, 
impractical or even impossible. 


This difference between optimisation and exploration becomes very obvious when the literature in 
this area is examined. It becomes evident that every creative evolutionary system uses this idea of 
component-based representation in some way. Researchers who evolve architecture use evolution to 
manipulate components such as walls or bricks. Researchers who evolve electronic circuits use evolution 
to modify components such as logic gates, transistors and capacitors. Artists use evolution to create art 
out of primitive shapes: swirls, spheres, tori, or out of mathematical functions such as cosine, arctangent 
and factorial. Likewise, computer scientists using GP evolve programs from components contained 
within the function and terminal sets. Bentley’s work uses cuboid blocks to construct designs, fuzzy logic 
functions to construct fuzzy rules and musical notes to construct compositions. Every explorative 
evolutionary system relies on some kind of component-based representation. Figure 1.16 illustrates this 
idea, showing how components allow increased freedom for evolution. 

Evolutionary algorithms, and in particular genetic algorithms and genetic programming, naturally 
lend themselves to this kind of exploration. It is standard practice to use evolution to manipulate coded 
versions of solutions (genotypes) and to map these onto actual solutions (phenotypes). This use of 
genotypes and phenotypes means that the distinction between, and use of, components of solutions and 
complete solutions is natural to this field. 
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Figure 1.16 Optimisation of fixed parameterisation versus component-based exploration. The shape 
of the left uses minimal parameters and is knowledge-rich (the height of the shape and the fact that the 2D 
outline is swept to give a 3D shape are assumed by this representation). The shape on the right is 
constructed by wrapping an envelope around a collection of 3D ellipses. By varying the relative positions 
and sizes of the ellipses, vastly more innovative and creative forms can be generated. 


1.4.5 A Framework for Creative Evolution 


From this investigation of creative evolutionary systems, we can construct a framework which contains 
five elements (see figure 1.17): 


G An evolutionary algorithm. 

° A genetic representation. 

d An embryogeny using components. 

: A phenotype representation. 

è Fitness function(s) / processing of user input. 


To summarise, a creative evolutionary system requires some kind of evolutionary algorithm to 
generate new solutions. The algorithm modifies genotypes defined by the genetic representation, which 
should be designed to minimise disruption caused by the genetic operators. An embryogeny (or mapping 
process) should decode the genotype, and using some kind of components, should construct the 
phenotype. The phenotype representation should be designed such that it permits quick and efficient 
evaluation by the fitness function(s). It is likely that the evolutionary algorithm, the genetic representation 
and to some extent the embryogeny, will be generic and suitable for reuse for most problems without 
modification. The phenotype representation and fitness functions will usually be specific to the current 
application of the system. The fitness functions may also be designed to process human input rather than 
actually evaluate the solutions directly. The following sections explore the elements of the framework for 
explorative evolutionary systems in more detail: 
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Evolutionary Algorithm 


Genetic representation 
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Fitness functions and/or 
processing of user input 


Figure 1.17 The five elements of the framework for creative evolutionary systems. 


Evolutionary Algorithm 

The evolutionary algorithm forms the core of any evolutionary system. As described earlier, there are 
four main EAs in use today: the genetic algorithm, genetic programming, evolutionary strategies and 
evolutionary programming. Sadly, only the GA and GP are commonly used for the exploration of creative 
solutions. The reason for this can perhaps be found in the way these algorithms work. The genetic 
algorithm maintains genotypes and phenotypes, with a mapping between the two. As described earlier, 
this distinction has helped to encourage some GA researchers to use component-based genotype 
representations that map onto the phenotype representations, thus allowing explorative evolution to begin. 
In the same way, genetic programming also makes use of genotypes (this time with tree-structures) that 
are mapped onto phenotypes such as programs, images or circuits. GP has the advantage that its genetic 
representation requires the use of smaller components (in the function and terminal sets), so all 
applications of GP demonstrate the explorative power of evolution. This may explain why the first notion 
of “invention machine” came from John Koza, the inventor of GP - his algorithm ensures that explorative 
evolution will always take place. In contrast, algorithms such as evolutionary strategies and evolutionary 
programming make no distinction between genotype and phenotype. By directly modifying the solution 
and with no provision for mapping to new representations, these approaches make the use of components 
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to construct solutions difficult to implement and hence almost unheard of in this field. Nevertheless, there 
is nothing inherent in any evolutionary algorithm that prevents its use in a creative evolutionary system. 

Within any evolutionary algorithm there are other issues that must be tackled. Handling multiple 
objectives, multimodality, noise, premature convergence, fuzzy or changing fitness functions must all be 
considered. Solutions to all of these problems, using ideas such as Pareto optimality, region identification, 
speciation, variable or directed mutation rates and steady-state GAs are now emerging in evolutionary 
computation (Bentley, 1999c; Parmee, 1999; Vavak & Fogarty, 1996). These issues, although important, 
are not the most significant consideration for creative evolution. Indeed, even the choice of evolutionary 
algorithm (or indeed any other search algorithm) is secondary to the representations, for it is the 
representations that permit evolution to explore. 


Genotype Representation 

The genotype representation defines the search space of the algorithm. A poor representation may 
enumerate the space such that very dissimilar solutions are close to each other, making search for better 
solutions harder. For creative evolutionary computation, where genes will represent (directly or 
indirectly) a variable number of components, the search space is typically of variable dimensionality, thus 
making its design even harder (Gero & Kazakov, 1996). 

There are also other problems. Because of the use of components to represent solutions, the 
likelihood of epistasis dramatically increases. Not all component-based representations will have this 
effect (e.g. a one to one mapping with a voxel representation allows both exploration and zero epistasis). 
However, most components are inherently linked to their companions for the solution to work as a whole. 
A circuit relies on the links between its components, a melody relies on links between notes, a house 
relies on links between walls, a program relies on links between commands. These linkages all mean that 
corresponding genes become epistatically linked, resulting in potentially serious problems for evolution. 
With polygeny so prevalent in these problems, great care must be taken in the design of the genotype 
representation and corresponding genetic operators to minimise the disruption of inheritance. 

Practitioners of GP have long been aware of these problems, with many solutions now in existence. 
Modifications can be made to the genetic representation to increase functionality and decrease disruption, 
e.g. encapsulation, ADFs, ADIs, ADLs, etc. (Koza et al, 1999). New genetic operators that enforce typing 
help ensure that genetic trees are not shuffled too drastically during the production of offspring (Page et 
al, 1999). 

GAs do not require the use of tree-structured genotypes, so genetic representation-based problems 
are often less prevalent. GAs can be used to evolve variable-length genotypes and structured genotypes, 
typically with operators designed to perform crossover only at points of similarity between two parent 
genotypes, for example (Bentley & Wakefield, 1996) and (Harvey, 1992). Advanced GAs designed to 
minimise damage caused by disruption of epistatic links between genes have also been demonstrated 
(Goldberg, 1999). In addition, GAs do not suffer from the classic GP problem of bloat, where genotypes 
tend to increase in size, with redundant genetic material becoming ever greater in solutions. It is clear that 
the creation of suitable genetic representations and corresponding operators is a considerable problem in 
its own right. Furthermore, recent research indicates that significant benefits may be gained from using 
less complex genetic representations and operators, instead making use of embryogenies of greater 


complexity (Bentley & Kumar, 1999). 


Embryogeny 

An embryogeny is a special kind of mapping process from genotype from phenotype. Within the process, 
the genotype is now regarded as a set of ‘growing instructions’ — a recipe which defines how the 
phenotype will develop. Polygeny is common, phenotypic traits being produced by multiple genes acting 
in combination. Research in this area has revealed some of the potential of these advanced mapping 
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processes. Advantages include reduction of the search space, better enumeration of search space, the 
evolution of more complex solutions, and adaptability (Bentley, 1999c). 

Embryogenies are widely used for explorative evolutionary systems, for they provide the mechanism 
for constructing whole solutions from components. Three types of embryogeny are used today, the first 
and most common being external, where a programmer writes the software that performs the mapping, 
and the process cannot be evolved — it is external to the genotype (Bentley, 1999c). More recently, 
explicit embryogenies have become popular, with every step of the growth process explicitly held as part 
of the genotype, and evolved (Bentley, 1999c). Examples include Cellular Encoding (used by Koza and 
team for the evolution of analogue circuits; Koza et al, 1999), Lindenmayer Systems (used by Coates for 
the evolution of architectural forms; Coates, 1997) and shape grammars (used by Gero for the evolution 
of floor plans; Schnier & Gero, 1996). Despite the considerable success of these embryogenies, they often 
require complex additions to genetic representations and operators to allow evolution to work. The third 
type of growth process, the implicit embryogeny, has shown the most exciting results and greatest 
potential in recent work. Instead of evolving the mapping as a set of explicit steps in the genotype, an 
implicit embryogeny uses a set of rules, typically encoded as binary strings in a GA genotype. For each 
solution, a ‘seed’ component is created, and then the rules are iteratively applied. Over many iterations, 
with rules activating and suppressing each other, the growth, position, and type of new components are 
built up, finally resulting in the development of a complete solution. This emergent growth process shows 
remarkable properties of scalability, with the genotype describing solutions of increasing complexity 
without any increase in the number of rules needed - the rule-directed growth process is simply allowed 
to run for more time. This is in contrast to all other approaches, which require significantly larger 
genotypes to define the increased growth of more complex solutions (Bentley & Kumar, 1999). 

The process of mapping from genotypes to phenotypes is clearly of importance to the investigation 
of explorative evolution. Issues of scalibility, evolvability, and biases induced in search have yet to be 
considered by researchers in any great depth. Increased understanding in this area would benefit both 
computer science and developmental biology. 


Phenotype Representations 

Once constructed by the embryogeny, the resulting solution is defined by the phenotype representation. 
Typically this representation is specific to the current application - if we are evolving circuits, the 
representation might define networks of connected components, if we are evolving buildings, the 
representation might define exterior shapes and/or interior walls, floors and stairs. An important criterion 
is evaluation - typically the phenotype representation will be designed to allow direct evaluation by 
fitness functions, without intermediate transformations or calculations. A poor choice will detrimentally 
affect processing times and solution accuracies. 

The distinction between genotype, embryogeny and phenotype representations is often blurred in this 
field. Some GP practitioners regard all three to be the same. Others, such as Jakobi's work on evolving 
neural networks (Jakobi, 1996) or Taura's work on evolutionary configuration design (Taura & Nagasaka, 
1999), use different and distinct representations for each stage. It is still unclear whether the component 
growing process of the embryogeny should use the same representation as the phenotype - should the 
phenotype be represented by blocks or should the blocks be merged into a single, whole description of the 
solution? For example, should an evolved musical composition be represented by a series of notes or by a 
single, complex waveform in the phenotype? The answer is likely to depend on the fitness functions. 


Fitness Functions and/or Processing of User Input 

The fitness functions must provide an evaluation score for every solution. For creative evolutionary 
computation, this is often a little harder. Typically the use of components rather than a parameterised 
solution means that early results can be chaotic to say the least. A design of a car may resemble a shoe; a 
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melody may sound like a burglar alarm. Before evolution has had time to improve these initially random 
solutions, they can be nothing at all like the desired result. And yet the fitness functions must always be 
able to provide a fitness score that makes sense. The task is made even harder when unknowns or 
approximations must be incorporated into the evaluation, or when constraints and objectives are varied to 
aid exploration. Potential solutions include the use of custom-designed modular functions (Bentley, 1996) 
and fuzzy logic (Parmee, 1999) to cope with such problems. 

As discussed earlier, many creative systems use human input to help guide evolution. Artists can 
completely take over the role of a fitness function (Sims, 1991; Todd & Latham, 1999), and more recent 
work has investigated the use of these techniques for evolving photo-realistic images of faces - potentially 
useful for the identification of criminals (Hancock & Frowd, 1999), and see chapter 17. These 
applications raise numerous human-computer-interfacing issues, i.e., will a creative system detrimentally 
affect the style of an artist or the memory of a crime victim? These software tools have been shown to aid 
imagination and creativity, but how best to let the user inform evolution of his/her preferences and how 
best for the computer to report the structure and contents of the space being explored? Clearly, further 
research is required to address these issues. 


1.4.6 Example Creative Application 


To illustrate the potential of creative evolutionary systems, we will now explore a simple application - the 
generation of shapes that, when constructed out of paper, fall as slowly as possible to the ground. In this 
case we will not use human interaction — this will be the second type of creative evolutionary system 
described earlier. 

We can construct a simple creative evolutionary system, following the framework provided 
above. A ‘simple GA’ can be used as the evolutionary algorithm (Goldberg, 1989). The genotype 
representation can be a flat chromosome of 16 binary coded genes. A very basic mapping process or 
embryogeny can be used to derive 8 (x, y) parameter values from each chromosome, join each vector to 
its successor by an edge, join the last vector to the fist with an edge, and fill the resulting shape. An easy 
way to perform this process is to execute PostScript instructions output by the system, print the shapes, 
and use a scalpel to cut out the shapes, see figure 1.12. The resulting paper phenotypes (‘represented’ by 
reality) can then be tested by releasing them from a height of 150mm three times in succession. Each 
phenotype can be allocated their fitness score by calculating: 1/(timel+time2+time3), ensuring that 
evolution would attempt to generate phenotypes with increased ‘falling times’. 


54 


Creative Evolutionary Systems 


GENOTYPE 


001111001100110011111000011110110101000010101100101110001010000100 
1101101001000101011100000010100011000111010101001010110111011100110 


(60 204) (496 246) 7 : 
ae e ae oe, ee derive components 
(58 330) (110 230) 


0.75 setgray 
4 setlinewidth 
60 204 moveto 
496 246 lineto 
322 178 lineto make postscript 
226 132 lineto instructions to construct 


436 138 lineto 
448 326 lineto shape from components 


58 330 lineto 
110 230 lineto 
closepath 
stroke 


AND OAS a IN SS 


N print and cut out 


iy the shape 
QY 


PHENOTYPE 


Figure 1.18 The paper fall application uses eight vertices as its components. These are extracted 
from the genotype and transformed into real paper shapes by the use of a ‘join the dots and fill the shape’ 
embryogeny (and someone to print and cut out the shape). 


This application illustrates the use of an extremely basic component-based embryogeny 
representation. As figure 1.18 illustrates, the components are simply eight vertices with (x, y) positions. 
Despite these components having no size and no type, the unconstrained freedom of position of each 
vertex relative to all other vertices means that this component-based representation allows the definition 
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of a vast number of different shapes. Clearly this is a knowledge-lean representation (no information 
about which shapes are best is provided). It should also be clear that the representation allows evolution 
to explore the solution space in an unconstrained manner, and that there will be many millions of good 
and bad solutions for this problem. 

Predictably, the use of real-life testing is time-consuming and laborious (especially if you make the 
mistake of performing the experiment yourself instead of enlisting the services of a student). 
Consequently, for the purposes of this illustration, population sizes of 10 individuals were used in an 
evolutionary run of 10 generations, performed for this chapter. 

The results were interesting. Despite these excessively low values, evolution was able to make 
significant improvements on the time taken for the shapes to reach the ground. In the experiments, times 
taken for initially random shapes to fall 150mm varied from 0.7 seconds to 1.8 seconds. By the tenth 
generation, all shapes took, on average, more than 2 seconds to fall the same distance. Figure 1.19 shows 
two of the solutions in the final population. Convergence has begun to occur, with most shapes using the 
same technique of having a smaller flap which causes the shapes to rotate as they fall. The main benefit 
of this solution appears to be the way rotation stabilises the motion of the shape, preventing it from 
slipping sideways in the air and plummeting to the ground at tremendous speed. Even with the very 
limited resources evolution was given, a ‘creative’ solution to the problem was found. 


Figure 1.19 Two paper shapes evolved to fall slowly through the air. Both are members of the final 
generation, and both use a smaller ‘arm’ or flap to cause the shape to rotate as it falls, like a sycamore 
seed. (Not shown at scale used for testing.) 


1.4.7 From Creative Evolutionary Systems to Creativity 


This middle section of the chapter has introduced the ideas behind creative evolutionary systems. Such 
systems are used to aid the creativity of a user by helping them to explore ideas during evolution, or help 
show users new ideas and concepts by generating innovative new solutions to problems previously 
thought to be only solvable by creative people. A brief background of the field was given, showing how 
difficult applications such as architecture, programming, circuit design, art and music composition 
triggered the development of a new approach. By using human interaction we can enable the evolution of 
aesthetically pleasing and other difficult-to-evaluate solutions. By employing knowledge-lean 
component-based representations, we remove constraints to search in the representations and allow 
evolution to assemble new solutions. Using such methods we have turned evolution into an explorer of 
what is possible, instead of an optimiser of what is already there. 

Now that we have a much clearer idea of what a creative evolutionary system is, it is time to look at 
the hardest question of all - is it really creative? 
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1.5 Is Evolution Creative? 


1.5.1 Introduction 


Although we have defined the term ‘Creative Evolutionary Systems’ earlier, this chapter would not be 
complete without some discussion of creativity itself. It is clear that evolution can aid in our own 
creativity, perform tasks that previously needed creative people and indeed, in some cases produce results 
in a seemly creative manner. But is there any justification at all in using this rather contentious word to 
describe a scientific field? Some would argue yes, others no. This final section of the chapter explores the 
meaning of this word and how it relates to evolution. 


1.5.2 Creativity 


Creativity is somehow almost magical. We all recognise manifestations of creativity without effort, yet 
this mysterious property or ability remains aloof from our attempts to understand it. Creativity is another 
‘fuzzy’ word, a word with vast connotations, many inextricably entwined with the pride of individuals. It 
is a very ‘humanistic’ word, used primarily to describe human skills and abilities, and almost without 
exception, it is used as a positive descriptor. And it is clear to see why the label ‘creative’ is one to be 
proud of. With meanings such as aesthetic, lovely, poetic, beautiful, skilled, proficient, inventive, elegant, 
surely this deceptively simple word is overflowing with compliments. 

But not only does this word allude to admiration, it also implies genuine ability. Our most creative 
members of society are often regarded as our highest achievers. Whether the accomplishment is a new 
form of art that shocks in its radical novelty, or whether it is a theorem that describes the physical laws of 
our universe in a more concise and elegant manner, there can be little doubt of the creativity involved. 

Yet creativity does not necessarily mean the creation of a tangible something. To be creative often 
appears to be the ability to find a solution where others fail. Again, an extremely useful ability; it can be 
argued that many of the best leaders in history gained their successes through creative political (or 
military) thinking. Certainly, many of the remarkable feats of survival and rescue can be attributed to the 
quick thinking of creative individuals — a classic example being the recovery of the Apollo 13 crew from 
the brink of tragedy. 

Being creative is clearly a good thing. 


1.5.3 Evolution 


Evolution is not a person. It is an unthinking, blind process, a relentless procedure, a harsh and 
unconscious fact of life. How can we possibly call something so inhuman, so brutal, creative? 

Perhaps we should not, but delving past such moral prejudices, evolution can be seen in a different 
light. Evolution has been hard at work creating the myriad forms of life that have lived and died on our 
world for thousands of millions of years. In that unimaginably vast amount of time, designs of life wholly 
beyond our current comprehension have emerged. From the complex miniature chemical factories 
contained within every cell of your body, to the immensely complicated organisation of your brain, which 
even as you read this, performs unfathomable chemical and electrical changes, evolution is a master of 
design. 

Examples of aesthetic, lovely, poetic and beautiful evolved solutions surround us, are contained 
within us, and are us. Every living thing cries out proficiency, elegance, inventiveness and skill in design. 
The abilities of natural evolution far surpass our most creative problem solvers. Moreover, as biologists 
uncover more information about the workings of the creatures around us, it is becoming clear that many 
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human solutions have existed in nature long before they were thought of by any human (French, 1994), 
for example: pumps, valves, heat-exchange systems, optical lenses, sonar. Indeed, many of our recent 
designs borrow features directly from nature, such as the cross-sectional shape of aircraft wings from 
birds, and Velcro from certain types of ‘sticky’ seeds. 

Of course our own achievements are remarkable and many do not exist in nature. Even something as 
simple as the wheel is not used in the natural world. But it must be remembered that natural evolution is 
constrained to the creation of life — all of its designs must be capable of self-replication, and nearly all 
must grow from a single cell, following the evolved instructions contained within the genetic makeup of 
that cell (Dawkins, 1986). 

But now this constraint is no longer valid. Evolutionary computation allows us to harness the power 
of evolution for non-living designs. In this new digital domain, evolution can evolve the wheel or the 
electronic circuit. We can use evolution to generate music and art. Evolutionary algorithms permit us to 
exploit the remarkable properties of natural evolution, endowing our computers with skills which 
suspiciously resemble creativity. Even for such mundane tasks as evolving the design for a coffee table, 
evolution shows surprising originality. To illustrate this, figure 1.20 shows twenty coffee table designs, 
evolved by Bentley’s generic evolutionary design system (GADES). From the same set of functional 
criteria, and without any human intervention, twenty very different solutions were evolved (Bentley, 
1999a) — many using very original and unusual ideas. Figure 1.21 shows the design that was ultimately 
chosen, and a photograph of the final table, built according to this design. 

As the simple illustrative example shows, evolution certainly seems to exhibit some of the properties 
of creativity. It is still unclear, however, if evolution can truly be termed creative. 


1.5.4 Creative Evolution? 


There are an almost unlimited number of different definitions that exist for creativity. To determine 
whether evolution can be considered creative, it seems appropriate to explore some of those definitions 
that deal with creativity in terms of computers and evolution. There are two main types of creativity that 
are considered here: similar to Gero’s (1996) ‘cognitive’ and ‘social views’: an individual can display 
creativity when performing some action, and the physical result of some action can display characteristics 
which may be regarded as being creative. The first two definitions refer to the results of evolution. They 
explore whether such evolved results can be considered creative, and if so, whether this implies evolution 
is creative. The next six definitions refer to the process itself — does evolution generate solutions to 
problems creatively? 
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Figure 1.20: Twenty coffee table designs evolved by GADES. 
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Figure 1.21: The evolved design of a coffee table and a photo of the actual table. 
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Generating ‘surprising and innovative solutions’ (Gero & Kazakov, 1996) 

As many of the chapters of this book show, there can be no doubt that natural evolution is capable of 
innovation. It is also clear that evolutionary computation displays surprising levels of novelty. Even for 
very simple problems such as the one shown in figure 1.20, evolutionary algorithms are capable of 
finding unusual and original solutions. 

Consequently, according to this definition, there can be no doubt that evolution is creative, but it 
seems that the definition may be too general. The patterns of frost on a window, snowflakes, sand dunes, 
and formations of eroded rock can all be described as surprising and innovative, so if evolution is called 
creative, then according to this interpretation, the laws of physics and the four elements must also be 
creative. Perhaps there is some justice to this, for if the blind process of evolution is creative, then why 
shouldn’t the blind forces of nature such as tides and winds also have the same linguistic honour endowed 
upon them? However, the difference between the evolution of life, and the erosion or formation of 
inanimate objects seems too great to ignore. 


Creating ‘novel solutions that are qualitatively better than previous solutions’ (Gero & 


Kazakov, 1996) 


This is a more rigorous definition, and it overcomes the problems discussed above. No snowflake or rock 
formation is better or worse than any other, they simply exist, and may or may not be elegant and 
attractive. In contrast, the essence of evolution is improvement over time. Evolution does generate 
qualitatively better solutions, because unlike inanimate objects in nature, evolution generates solutions 
better able to survive. Whilst the task of survival is constantly changing and the success rate of each 
living design constantly varies, useful survival skills such as the ability to fly, see, run, swim and so on, 
have improved. Natural evolution, without doubt, generates qualitatively better solutions than previous 
ones. 

In evolutionary computation, the same is true. Generation by generation, solutions are improved. 
Particularly in applications where evolution is permitted to vary aspects of the representation, the final 
evolved solutions are qualitatively better compared to the initially random solutions. When comparing 
designs evolved by computers with our own designs, evolution is also capable of providing substantial 
improvements, and in some cases, genuinely original design concepts (Bentley, 1999a). 

So evolution, once again, seems to be creative. But still the definition seems incomplete. Rather than 
focussing on the results of evolution and attempting to determine by proxy whether their generation 
implies creativity, it seems more appropriate to concentrate on how the solutions are found. Are they 
found creatively? 


The lesser the knowledge about existing relationships between the requirements and 
the form to satisfy those requirements. (Rosenman, 1997) 


This definition of creativity states that the ability to generate good solutions even when very little or no 
information about the fundamental nature of the solutions is provided, implies that the generation process 
must be creative. Natural evolution always satisfies this, for there is no knowledge provided anywhere 
about which solutions should be favoured — the fittest simply survive (unless one believes in divine 
intervention). Evolutionary computation does not always satisfy this definition. When using evolution to 
optimise given parameters in a predefined structure, considerable knowledge is embedded within that 
representation, hence there can be no creativity. However for problems which employ evolution as a 
generative technique, such knowledge can be reduced to a bare minimum (e.g. a design grammar which 
provides a means to define designs without indirectly providing knowledge of which designs are best). 
Because of this greater discrimination, Bentley employs this definition of creativity for creative 
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evolutionary design (Bentley, 1999c). However, some regard this as insufficient to capture the essence of 
creativity. 


Exploring a search space in an innovative and efficient way 

From a computational point of view, evolution is simply a special kind of search algorithm. Some argue 
that for evolution to be considered creative, it must traverse its search spaces in a creative manner, i.e. it 
must be innovative or efficient in its search. Exhaustive search and random search are examples of 
noncreative techniques. Evolutionary algorithms are good examples of creative search. Although we have 
few proofs that coherently describe the behaviour of evolutionary algorithms, through experimentation 
and analysis we have learned that evolutionary techniques have excellent abilities as general-purpose 
problem solvers. Indeed, as Goldberg (1989) states, the genetic algorithm is ‘a search algorithm with 
some of the innovative flair of human search’. 

In a sense, this definition draws a parallel between the innovative thinking by a creative person, and 
the innovative searching by a creative algorithm. However, the application of this definition remains 
difficult, for although it seems that evolution probably is creative, it would seem to be just as hard to 
define the boundaries between creative and noncreative search as it is to define them between creative 
and noncreative thought. 


Exploring alternative search spaces (Gero, 1996) 


By redefining the search space, or indeed, constructing new search spaces in which to find solutions, a 
search process can be considered creative according to this definition. Just as our creative thinkers find 
alternative ways to look at problems, if evolution can enhance or change its search space, it will be 
creative. 

This is another, more discriminative interpretation, which is a little harder for evolution to satisfy. 
Using evolution as a simple optimiser of fixed parameters is clearly not creative. However natural 
evolution and some of the more advanced evolutionary algorithms are capable of varying their 
representations. Such evolutionary approaches can have considerable freedom to modify their 
representations in parallel to the evolution of solutions. They can alter the coding, vary the genome 
length, employ redundant genetic material, select useful functional elements and even create higher-level 
building blocks. Once again, at least some of the more complex forms of evolution can be considered 
creative. 


Transferring useful information from other domains (Goldberg, 1999; Holland, 1998) 
Goldberg (1999) makes the distinction between innovation and creativity with this definition. He feels 
that innovation involves discovery within a discipline, whereas creativity requires a transfer of knowledge 
from without. Holland (1998) makes a very similar point in his discussion of metaphors, and how 
knowledge in one area can be applied to a different subject in order to change the perceptions and 
understanding of that subject. 

In nature there are no clearly defined domains of knowledge. Perhaps different species could be 
regarded as distinct archives of knowledge, but natural evolution does not transfer such information, for 
interbreeding is usually unsuccessful. Some argue that knowledge of previous solutions that were 
successful during alternative environmental conditions is held in junk DNA for future reuse, but this is 
hardly knowledge transfer from a different domain. Goldberg does suggest that the transfer of knowledge 
about better knowledge representation may be one aspect of creativity, and it is argued that natural 
evolution does evolve such evolvability (Dawkins, 1989). However, this seems a somewhat contrived 
argument. Consequently, according to this definition, natural evolution is probably not creative. 
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Evolutionary computation does not currently include methods to identify and transfer knowledge 
from other domains to aid search. Goldberg feels that it is conceivable in the future, but it seems unlikely 
that evolution will be used to perform this, rather that the ‘creative’ process according to this definition 
would be performed by the knowledge identification, transfer and conversion software. 


Going beyond the bounds of a representation (Boden, 1992) 

Boden (1992) feels that to be creative it is necessary to find a novel solution that simply could not have 
been defined by a representation. She suggests that this is the nature of a paradigm shift, where entirely 
new approaches to the representation of problems are found. This precludes the transfer of knowledge 
into the current representation as suggested by the previous definition. Instead, a different representation 
would be required. Boden does not feel that computers will ever be capable of such creativity (Boden, 
1992). 

Whilst this may appear analogous to the behaviour of creative thinkers in our society, it seems to 
ignore the fact that our own brains are fundamentally single-representation devices. At the lowest level, 
they must always use neurons, chemical and electrical signals, so whilst many alternative higher-level 
representations can be expressed, they must always be defined using this “wetware’. 

Evolution (natural and computational) is similarly constrained to a low-level representation, this time 
genetic, but equally capable of defining higher-level representations of immense diversity and 
complexity. It therefore seems that, with respect to this definition, evolution and the human brain are 
equally likely (or unlikely) to be capable of creativity. 


Expressing your soul 

Some insist that creativity is an expression of your soul. This one of the more controversial definitions of 
creativity and one of the hardest to satisfy for nonhuman activity. Whether you believe in the soul or not, 
few would argue that a computer or the process of evolution possesses one. Clearly, evolutionary 
computation cannot satisfy this definition — unless we ever construct living machines, whatever they 
might be. However, natural evolution is a special case — for if it is the working of God, then it must be 
creative. 


1.5.5 Subjective Creativity 


According to six (out of eight) of the definitions we have examined here, the more advanced forms of 
evolution can be considered to be creative. But in the end, it seems that the magical property of creativity 
is simply too subjective and anthropocentric a word to allow its unequivocal usage for evolution. The 
final judgement must be a personal one, but it is possible to give four responses from people with 
different outlooks on the world. These views are amalgamations of the views presented during a number 
of discussions on this subject. Although titles for each type of view have been given, this is more for 
convenience of reference than an attempt at accurate generalisation. 


The Atheist 
Does not believe in creativity. All novelty is as a result of random chance, complexity is a result of 
physical laws and natural selection. 'Creative' individuals are simply individuals with brains that are 


better able to process information. 


The Religious 
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If natural evolution is considered to be the way in which God designs the living world, then it must 
be creative. However, a computer performing evolution does not involve God in this way, or a human 
soul, so it cannot be creative. 


The Artist 
Often inspired and awed by the forms evolved in nature, finds evolution to be very creative. 


The Scientist 
Finds the results of evolution to be creative, but expresses doubts as to whether the process can be 
given the human descriptive word ‘creative’. 


1.6 Summary of Chapter 


This chapter has provided an introduction to creative evolutionary systems. We began with an overview 
of evolutionary algorithms, explaining the main algorithms, and showing how all evolutionary algorithms 
are fundamentally the same. The middle section of the chapter defined and described creative 
evolutionary systems, showing why they were developed and how user interaction and changes of 
representation can expand the capabilities of evolution. The last section of the chapter has explored the 
taxing question of whether a creative evolutionary system can be said to actually work creatively. 

This chapter is but an introduction to the diversity of techniques that fall under the heading of 
creative evolutionary systems. It is intended to provide you with some grounding, making your 
explorations of the other chapters in this book more fruitful. And we hope you do find this book useful - 
as the first of its kind on this topic, we feel confident that it provides the latest and most up-to-date ideas, 
methods and results for creative evolutionary systems. 
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